Jul 14 19:37:54.823007 ip-10-0-136-12 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 19:37:55.255150 ip-10-0-136-12 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:37:55.255150 ip-10-0-136-12 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 19:37:55.255150 ip-10-0-136-12 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:37:55.255150 ip-10-0-136-12 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 19:37:55.255150 ip-10-0-136-12 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 19:37:55.256040 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.255895    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 19:37:55.260281 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260264    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:37:55.260281 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260281    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260285    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260289    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260292    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260295    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260298    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260301    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260304    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260306    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260309    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260313    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260316    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260319    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260322    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260326    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260329    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260331    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260334    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260337    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:37:55.260347 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260340    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260343    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260346    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260348    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260351    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260354    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260357    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260360    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260364    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260366    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260369    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260371    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260374    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260377    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260380    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260383    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260386    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260389    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260391    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260394    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:37:55.260830 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260396    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260399    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260402    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260405    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260408    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260410    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260415    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260419    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260422    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260425    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260428    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260431    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260434    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260436    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260440    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260443    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260446    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260449    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260452    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:37:55.261328 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260455    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260460    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260463    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260465    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260468    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260471    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260474    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260477    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260479    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260482    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260485    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260488    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260490    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260493    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260495    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260498    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260501    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260504    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260508    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260513    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:37:55.261826 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260516    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260519    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260522    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260525    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260530    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260533    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260536    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260540    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260544    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260546    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260549    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260552    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260555    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260558    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260561    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260564    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260566    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260569    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260572    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:37:55.262349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.260575    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261319    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261326    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261329    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261332    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261335    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261340    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261343    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261345    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261348    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261351    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261354    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261357    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261360    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261363    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261366    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261369    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261372    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261375    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261377    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:37:55.262834 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261381    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261383    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261386    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261390    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261392    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261395    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261398    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261401    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261403    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261406    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261409    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261412    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261414    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261417    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261420    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261422    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261425    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261428    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261431    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261434    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:37:55.263367 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261436    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261439    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261442    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261445    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261448    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261451    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261455    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261459    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261463    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261466    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261469    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261472    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261477    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261481    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261484    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261487    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261490    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261493    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261497    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:37:55.263884 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261500    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261503    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261505    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261508    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261511    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261513    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261516    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261519    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261522    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261525    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261529    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261532    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261534    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261537    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261542    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261545    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261549    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261556    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261559    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:37:55.264358 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261562    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261565    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261567    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261571    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261574    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261577    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261580    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261583    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261586    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261588    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261591    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261594    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261597    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261600    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261603    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261606    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261608    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261611    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261614    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261617    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:37:55.264846 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261620    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.261622    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262048    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262055    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262059    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262062    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262066    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262069    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262072    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262075    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262080    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262084    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262087    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262090    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262093    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262096    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262099    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262102    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262105    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262108    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:37:55.265395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262111    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262113    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262116    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262120    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262122    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262125    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262128    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262131    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262134    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262136    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262139    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262142    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262144    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262147    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262150    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262165    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262169    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262172    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262176    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262179    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:37:55.265926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262182    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262185    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262190    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262192    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262195    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262199    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262201    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262205    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262208    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262210    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262213    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262216    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262219    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262222    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262225    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262228    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262231    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262234    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262236    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262239    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:37:55.266461 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262242    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262245    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262247    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262250    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262253    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262255    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262258    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262261    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262263    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262266    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262269    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262272    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262275    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262278    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262282    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262285    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262289    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262291    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262294    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262297    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:37:55.266990 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262299    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262302    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262305    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262308    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262311    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262314    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262322    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262326    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262329    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262333    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262337    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262340    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262343    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262346    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262349    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262352    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262356    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262359    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262362    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:37:55.267506 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262365    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.262367    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262435    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262442    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262448    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262453    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262458    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262462    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262466    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262471    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262474    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262477    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262481    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262485    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262488    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262491    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262494    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262497    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262500    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262505    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262510    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262513    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262517    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262520    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 19:37:55.268023 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262524    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262527    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262532    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262535    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262538    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262541    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262545    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262548    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262551    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262554    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262558    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262561    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262564    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262568    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262571    2569 flags.go:64] FLAG: --enable-server="true"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262575    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262580    2569 flags.go:64] FLAG: --event-burst="100"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262583    2569 flags.go:64] FLAG: --event-qps="50"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262586    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262589    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262593    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262597    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262600    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262603    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262606    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 14 19:37:55.268622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262610    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262613    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262618    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262621    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262624    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262627    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262631    2569 flags.go:64] FLAG: --feature-gates=""
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262635    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262638    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262641    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262644    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262648    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262651    2569 flags.go:64] FLAG: --help="false"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262654    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262658    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262661    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262664    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262668    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262672    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262675    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262678    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262681    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262685    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 19:37:55.269274 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262689    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262693    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262696    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262700    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262703    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262706    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262709    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262712    2569 flags.go:64] FLAG: --lock-file=""
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262716    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262719    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262722    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262730    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262733    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262736    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262740    2569 flags.go:64] FLAG: --logging-format="text"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262743    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262746    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262749    2569 flags.go:64] FLAG: --manifest-url=""
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262753    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262757    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262760    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262765    2569 flags.go:64] FLAG: --max-pods="110"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262781    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262785    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262788    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 19:37:55.269952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262791    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262795    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262798    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262801    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262808    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262811    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262814    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262818    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262821    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262826    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262830    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262833    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262836    2569 flags.go:64] FLAG: --port="10250"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262840    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262843    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01edb35fb6a74dfea"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262847    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262850    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262853    2569 flags.go:64] FLAG: --register-node="true"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262858    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262862    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262866    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262869    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262872    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262876    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262879    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 19:37:55.270881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262882    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262885    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262897    2569 flags.go:64] FLAG: --runonce="false"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262902    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262905    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262909    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262912    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262915    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262918    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262921    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262925    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262928    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262931    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262933    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262938    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262941    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262945    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262949    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262955    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262958    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262961    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262966    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262969    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262972    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262975    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 19:37:55.272020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262980    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262983    2569 flags.go:64] FLAG: --v="2"
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262988    2569 flags.go:64] FLAG: --version="false"
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262992    2569 flags.go:64] FLAG: --vmodule=""
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262996    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.262999    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263119    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263124    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263127    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263130    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263133    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263136    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263139    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263141    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263144    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263147    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263151    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263155    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263159    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263163    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263166    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:37:55.273224 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263170    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263173    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263176    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263179    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263183    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263186    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263188    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263191    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263194    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263197    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263200    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263204    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263207    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263210    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263213    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263216    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263218    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263221    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263224    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:37:55.274185 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263226    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263231    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263234    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263238    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263241    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263245    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263248    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263251    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263254    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263258    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263261    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263264    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263268    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263272    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263276    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263278    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263282    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263285    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263288    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:37:55.274857 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263291    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263293    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263296    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263299    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263301    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263305    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263308    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263311    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263314    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263317    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263320    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263322    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263325    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263328    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263331    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263333    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263336    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263339    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263342    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263344    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:37:55.275357 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263347    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263350    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263353    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263355    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263358    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263361    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263365    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263369    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263372    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263374    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263377    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263381    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263383    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263387    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263389    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263392    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263395    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263399    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263402    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263404    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:37:55.275912 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263407    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263410    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263413    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263416    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263418    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.263421    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.265035    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.272552    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.272574    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.272598    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.272608    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272707    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272716    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272721    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272726    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:37:55.276431 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272730    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272735    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272740    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272744    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272749    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272754    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272758    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272763    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272785    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272791    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272795    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272800    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272805    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272809    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272814    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272819    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272823    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272827    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272832    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272837    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:37:55.276847 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272841    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272846    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272850    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272855    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272860    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272867    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272872    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272877    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272881    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272885    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272890    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272894    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272899    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272903    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272908    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272912    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272916    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272921    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272925    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272929    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:37:55.277361 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272934    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272938    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272943    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272948    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272952    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272956    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272961    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272965    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272970    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272974    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272978    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272982    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272987    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272992    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.272996    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273001    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273005    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273011    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273016    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273021    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:37:55.277889 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273026    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273033    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273038    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273044    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273049    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273053    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273057    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273062    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273067    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273072    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273076    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273081    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273086    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273090    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273095    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273101    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273107    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273112    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273116    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:37:55.278395 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273121    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273125    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273130    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273135    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273139    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273144    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273149    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273153    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273158    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273162    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273167    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273172    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273177    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273184    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273190    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:37:55.278965 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273195    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.273205    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273393    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273402    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273407    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273412    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273417    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273422    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273426    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273430    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273435    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273440    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273445    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273449    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273454    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 19:37:55.279349 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273459    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273463    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273468    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273473    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273477    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273482    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273486    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273491    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273496    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273500    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273505    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273510    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273514    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273519    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273523    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273529    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273536    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273542    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273546    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 19:37:55.279796 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273552    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273557    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273562    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273568    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273572    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273577    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273582    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273587    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273592    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273596    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273601    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273605    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273610    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273614    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273619    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273623    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273627    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273632    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273637    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273642    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273646    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 19:37:55.280654 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273650    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273655    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273659    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273664    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273668    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273672    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273677    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273682    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273687    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273691    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273697    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273703    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273707    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273711    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273716    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273720    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273724    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273729    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273734    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 19:37:55.281441 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273739    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273745    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273751    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273757    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273761    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273766    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273787    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273792    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273796    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273800    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273805    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273809    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273813    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273818    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273822    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273827    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273832    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273836    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273841    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 19:37:55.282123 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273845    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273850    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273854    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273860    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273865    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273869    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273874    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:55.273878    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.273887    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.274067    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.276238    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.277323    2569 server.go:1019] "Starting client certificate rotation"
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.277432    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 19:37:55.282624 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.277476    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 19:37:55.282984 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.281458    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 19:37:55.283673 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.283656    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 19:37:55.294444 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.294425    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 14 19:37:55.297970 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.297954    2569 log.go:25] "Validated CRI v1 image API"
Jul 14 19:37:55.298883 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.298864    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 19:37:55.304177 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.304153    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b0bad2bd-4b7d-4c2c-b44d-887b40c98d2b:/dev/nvme0n1p4 fcaed65f-f532-46f1-959d-d08ecde2d707:/dev/nvme0n1p3]
Jul 14 19:37:55.304255 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.304175    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 19:37:55.310344 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.310227    2569 manager.go:216] Machine: {Timestamp:2026-07-14 19:37:55.308854227 +0000 UTC m=+0.366373761 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102875 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22ddcdf389060f672f189a4e6ac3c7 SystemUUID:ec22ddcd-f389-060f-672f-189a4e6ac3c7 BootID:21189f1c-6ab4-42c0-8f7c-709762abf1b5 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:68:ff:07:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:68:ff:07:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:c5:96:ca:3d:63 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 19:37:55.310344 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.310330    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 19:37:55.310489 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.310409    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 19:37:55.313248 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.313219    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 19:37:55.313395 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.313249    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 19:37:55.313461 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.313435    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 19:37:55.314295 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.314283    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 19:37:55.314332 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.314299    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 19:37:55.314332 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.314307    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 19:37:55.314903 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.314883    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 19:37:55.315627 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.315615    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 19:37:55.319252 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.319240    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 19:37:55.319376 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.319366    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 19:37:55.319411 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.319399    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 19:37:55.319448 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.319412    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 19:37:55.319448 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.319426    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 19:37:55.319448 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.319436    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 14 19:37:55.319448 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.319445    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 19:37:55.319821 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.319807    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 19:37:55.320012 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.319826    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 19:37:55.323237 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.323210    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 19:37:55.324702 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.324685    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 19:37:55.324764 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.324719    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 19:37:55.325308 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325294    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 19:37:55.325354 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325312    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 19:37:55.325354 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325319    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 19:37:55.325354 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325324    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 19:37:55.325354 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325333    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 19:37:55.325354 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325339    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 19:37:55.325503 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325415    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 19:37:55.325503 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325421    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 19:37:55.325503 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325428    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 19:37:55.325503 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325433    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 19:37:55.325503 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325443    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 19:37:55.325503 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.325451    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 19:37:55.326204 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.326193    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 19:37:55.326204 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.326204    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 19:37:55.329759 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.329746    2569 server.go:1268] "Started kubelet"
Jul 14 19:37:55.329866 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.329835    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 19:37:55.329932 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.329850    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 19:37:55.329932 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.329924    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 19:37:55.330624 ip-10-0-136-12 systemd[1]: Started Kubernetes Kubelet.
Jul 14 19:37:55.331835 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.331745    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 19:37:55.332347 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.332312    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 19:37:55.332444 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.332321    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 19:37:55.332513 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.332466    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 19:37:55.334931 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.334541    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 19:37:55.335240 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.335221    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 19:37:55.337489 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.337461    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 19:37:55.337489 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.337473    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 19:37:55.337675 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.337526    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-12.ec2.internal\" not found"
Jul 14 19:37:55.338080 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.337987    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 19:37:55.338080 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.337988    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 19:37:55.338080 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.338030    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 19:37:55.338236 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.338141    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 19:37:55.338236 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.338152    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 19:37:55.338597 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.338447    2569 factory.go:55] Registering systemd factory
Jul 14 19:37:55.338597 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.338467    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 14 19:37:55.338597 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.337255    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-12.ec2.internal.18c23f2f6dc41c8b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-12.ec2.internal,UID:ip-10-0-136-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-12.ec2.internal,},FirstTimestamp:2026-07-14 19:37:55.329719435 +0000 UTC m=+0.387238968,LastTimestamp:2026-07-14 19:37:55.329719435 +0000 UTC m=+0.387238968,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-12.ec2.internal,}"
Jul 14 19:37:55.338914 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.338825    2569 factory.go:153] Registering CRI-O factory
Jul 14 19:37:55.338914 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.338846    2569 factory.go:223] Registration of the crio container factory successfully
Jul 14 19:37:55.338914 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.338903    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 19:37:55.339064 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.338932    2569 factory.go:103] Registering Raw factory
Jul 14 19:37:55.339064 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.338951    2569 manager.go:1196] Started watching for new ooms in manager
Jul 14 19:37:55.339762 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.339657    2569 manager.go:349] Starting recovery of all containers
Jul 14 19:37:55.342881 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.342849    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 19:37:55.343526 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.343474    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 19:37:55.345937 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.345878    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 19:37:55.354038 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.354021    2569 manager.go:354] Recovery completed
Jul 14 19:37:55.358181 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.358167    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:37:55.360375 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.360355    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:37:55.360450 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.360393    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:37:55.360450 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.360409    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:37:55.361011 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.360997    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:37:55.361095 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.360996    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 19:37:55.361095 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.361026    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 19:37:55.361095 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.361041    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 19:37:55.361665 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.361650    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:37:55.361747 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.361682    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:37:55.361747 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.361698    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:37:55.363381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.363368    2569 policy_none.go:49] "None policy: Start"
Jul 14 19:37:55.363431 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.363385    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 19:37:55.363431 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.363397    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 19:37:55.363822 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.363753    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-12.ec2.internal.18c23f2f6f97e172  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-12.ec2.internal,UID:ip-10-0-136-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-12.ec2.internal,},FirstTimestamp:2026-07-14 19:37:55.360375154 +0000 UTC m=+0.417894689,LastTimestamp:2026-07-14 19:37:55.360375154 +0000 UTC m=+0.417894689,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-12.ec2.internal,}"
Jul 14 19:37:55.365579 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.365567    2569 policy_none.go:47] "Start"
Jul 14 19:37:55.383504 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.383334    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-12.ec2.internal.18c23f2f6f98440c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-12.ec2.internal,UID:ip-10-0-136-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-12.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-12.ec2.internal,},FirstTimestamp:2026-07-14 19:37:55.360400396 +0000 UTC m=+0.417919930,LastTimestamp:2026-07-14 19:37:55.360400396 +0000 UTC m=+0.417919930,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-12.ec2.internal,}"
Jul 14 19:37:55.399216 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.399148    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-12.ec2.internal.18c23f2f6f987f26  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-12.ec2.internal,UID:ip-10-0-136-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-12.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-12.ec2.internal,},FirstTimestamp:2026-07-14 19:37:55.360415526 +0000 UTC m=+0.417935061,LastTimestamp:2026-07-14 19:37:55.360415526 +0000 UTC m=+0.417935061,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-12.ec2.internal,}"
Jul 14 19:37:55.403346 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.403329    2569 manager.go:337] "Starting Device Plugin manager"
Jul 14 19:37:55.403443 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.403361    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 19:37:55.403443 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.403371    2569 server.go:87] "Starting device plugin registration server"
Jul 14 19:37:55.403689 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.403675    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 19:37:55.403746 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.403693    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 19:37:55.403844 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.403816    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 19:37:55.403916 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.403902    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 19:37:55.403960 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.403917    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 19:37:55.406433 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.406405    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 19:37:55.406545 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.406455    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-12.ec2.internal\" not found"
Jul 14 19:37:55.409365 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.409303    2569 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-12.ec2.internal.18c23f2f6f97e172\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-12.ec2.internal.18c23f2f6f97e172  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-12.ec2.internal,UID:ip-10-0-136-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-12.ec2.internal,},FirstTimestamp:2026-07-14 19:37:55.360375154 +0000 UTC m=+0.417894689,LastTimestamp:2026-07-14 19:37:55.361665434 +0000 UTC m=+0.419184969,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-12.ec2.internal,}"
Jul 14 19:37:55.420879 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.420807    2569 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-12.ec2.internal.18c23f2f6f98440c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-12.ec2.internal.18c23f2f6f98440c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-12.ec2.internal,UID:ip-10-0-136-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-12.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-12.ec2.internal,},FirstTimestamp:2026-07-14 19:37:55.360400396 +0000 UTC m=+0.417919930,LastTimestamp:2026-07-14 19:37:55.36168945 +0000 UTC m=+0.419208988,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-12.ec2.internal,}"
Jul 14 19:37:55.438325 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.438235    2569 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-12.ec2.internal.18c23f2f6f987f26\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-12.ec2.internal.18c23f2f6f987f26  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-12.ec2.internal,UID:ip-10-0-136-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-12.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-12.ec2.internal,},FirstTimestamp:2026-07-14 19:37:55.360415526 +0000 UTC m=+0.417935061,LastTimestamp:2026-07-14 19:37:55.361704617 +0000 UTC m=+0.419224151,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-12.ec2.internal,}"
Jul 14 19:37:55.447972 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.438637    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 19:37:55.447972 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.438678    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 19:37:55.447972 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.438697    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 19:37:55.447972 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.438739    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 19:37:55.450635 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.450617    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hgtjp"
Jul 14 19:37:55.452485 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.452454    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Jul 14 19:37:55.452597 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.452537    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-12.ec2.internal.18c23f2f7249c191  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-12.ec2.internal,UID:ip-10-0-136-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-136-12.ec2.internal,},FirstTimestamp:2026-07-14 19:37:55.405586833 +0000 UTC m=+0.463106357,LastTimestamp:2026-07-14 19:37:55.405586833 +0000 UTC m=+0.463106357,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-12.ec2.internal,}"
Jul 14 19:37:55.461329 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.461310    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hgtjp"
Jul 14 19:37:55.505280 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.505197    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:37:55.506316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.506297    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:37:55.506412 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.506329    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:37:55.506412 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.506347    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:37:55.506412 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.506377    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.530686 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.530660    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.530686 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.530690    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-12.ec2.internal\": node \"ip-10-0-136-12.ec2.internal\" not found"
Jul 14 19:37:55.538856 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.538834    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal"]
Jul 14 19:37:55.538916 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.538891    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:37:55.539845 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.539815    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:37:55.539845 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.539847    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:37:55.539974 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.539858    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:37:55.542259 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.542246    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:37:55.542381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.542364    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.542422 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.542397    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:37:55.542950 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.542934    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:37:55.543032 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.542956    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:37:55.543032 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.542957    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:37:55.543032 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.542968    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:37:55.543032 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.542997    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:37:55.543032 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.543016    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:37:55.545177 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.545157    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.545264 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.545184    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 19:37:55.545902 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.545886    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 19:37:55.545957 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.545918    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 19:37:55.545957 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.545932    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeHasSufficientPID"
Jul 14 19:37:55.564357 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.564334    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-12.ec2.internal\" not found" node="ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.566601 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.566582    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-12.ec2.internal\" not found" node="ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.574310 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.574290    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-12.ec2.internal\" not found"
Jul 14 19:37:55.674650 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.674615    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-12.ec2.internal\" not found"
Jul 14 19:37:55.745092 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.745060    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a73d3955fefc5adc829bb88b76c5af2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal\" (UID: \"4a73d3955fefc5adc829bb88b76c5af2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.745092 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.745095    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a73d3955fefc5adc829bb88b76c5af2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal\" (UID: \"4a73d3955fefc5adc829bb88b76c5af2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.745269 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.745115    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e9ca441aec6f18be4b0922c5dc5643a9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-12.ec2.internal\" (UID: \"e9ca441aec6f18be4b0922c5dc5643a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.774811 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.774746    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-12.ec2.internal\" not found"
Jul 14 19:37:55.845835 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.845804    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a73d3955fefc5adc829bb88b76c5af2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal\" (UID: \"4a73d3955fefc5adc829bb88b76c5af2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.845940 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.845829    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4a73d3955fefc5adc829bb88b76c5af2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal\" (UID: \"4a73d3955fefc5adc829bb88b76c5af2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.845940 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.845863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a73d3955fefc5adc829bb88b76c5af2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal\" (UID: \"4a73d3955fefc5adc829bb88b76c5af2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.845940 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.845892    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e9ca441aec6f18be4b0922c5dc5643a9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-12.ec2.internal\" (UID: \"e9ca441aec6f18be4b0922c5dc5643a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.845940 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.845912    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a73d3955fefc5adc829bb88b76c5af2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal\" (UID: \"4a73d3955fefc5adc829bb88b76c5af2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.846085 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.845945    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e9ca441aec6f18be4b0922c5dc5643a9-config\") pod \"kube-apiserver-proxy-ip-10-0-136-12.ec2.internal\" (UID: \"e9ca441aec6f18be4b0922c5dc5643a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.867503 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.867478    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.868660 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:55.868646    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:55.875607 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.875591    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-12.ec2.internal\" not found"
Jul 14 19:37:55.977142 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:55.977105    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-12.ec2.internal\" not found"
Jul 14 19:37:56.077969 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.077898    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-12.ec2.internal\" not found"
Jul 14 19:37:56.178851 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.178815    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-12.ec2.internal\" not found"
Jul 14 19:37:56.194965 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.194943    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:37:56.238761 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.238730    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:56.255210 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.255190    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 19:37:56.256832 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.256819    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal"
Jul 14 19:37:56.267508 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.267491    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 19:37:56.276879 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.276858    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 19:37:56.276990 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.276974    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 19:37:56.320316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.320286    2569 apiserver.go:52] "Watching apiserver"
Jul 14 19:37:56.328428 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.328384    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:37:56.334135 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.334117    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 19:37:56.335342 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.335320    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-stxdp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal","openshift-multus/multus-additional-cni-plugins-8l5kq","openshift-multus/multus-k5qgw","openshift-multus/network-metrics-daemon-qp8f5","kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl","openshift-dns/node-resolver-wchmn","openshift-network-diagnostics/network-check-target-lgct8","openshift-network-operator/iptables-alerter-nnf5s","openshift-ovn-kubernetes/ovnkube-node-q969l","kube-system/global-pull-secret-syncer-lxm7p","kube-system/konnectivity-agent-j8v8q","openshift-cluster-node-tuning-operator/tuned-brkw9"]
Jul 14 19:37:56.337795 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.337779    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 19:37:56.337916 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.337901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.340062 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.340043    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:37:56.340532 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.340515    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 19:37:56.340624 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.340607    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rhdc7\""
Jul 14 19:37:56.340808 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.340794    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 19:37:56.341241 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.341229    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 19:37:56.342219 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.342198    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nqncm\""
Jul 14 19:37:56.342316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.342300    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 19:37:56.342316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.342307    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.342496 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.342473    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 19:37:56.344456 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.344440    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.345812 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.345797    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 19:37:56.346734 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.346718    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:37:56.346832 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.346786    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 19:37:56.346895 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.346783    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:37:56.347040 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.347024    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 19:37:56.347116 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.347058    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 19:37:56.347172 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.347152    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 19:37:56.347172 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.347160    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 19:37:56.347395 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.347370    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9qk8w\""
Jul 14 19:37:56.348135 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.348041    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9f8vd\""
Jul 14 19:37:56.349790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.349355    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.349790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.349400    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-socket-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.349790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.349436    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-registration-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.349790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.349471    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-sys-fs\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.349790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.349505    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1a86d2d-d43b-49ed-9358-6483ff2f8394-konnectivity-ca\") pod \"konnectivity-agent-j8v8q\" (UID: \"d1a86d2d-d43b-49ed-9358-6483ff2f8394\") " pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:37:56.349790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.349535    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-device-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.349790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.349596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.349790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.349672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9xwm\" (UniqueName: \"kubernetes.io/projected/ecc6c844-9b73-47f9-95e2-a695bb2098c9-kube-api-access-q9xwm\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.349790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.349705    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1a86d2d-d43b-49ed-9358-6483ff2f8394-agent-certs\") pod \"konnectivity-agent-j8v8q\" (UID: \"d1a86d2d-d43b-49ed-9358-6483ff2f8394\") " pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:37:56.350150 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.349865    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.352078 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.352058    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:37:56.352166 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.352131    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:37:56.353473 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.353455    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 19:37:56.353875 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.353858    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:37:56.353947 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.353860    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9s2gl\""
Jul 14 19:37:56.354379 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.354362    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.356737 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.356721    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.357288 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.357273    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 19:37:56.357378 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.357358    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 19:37:56.357540 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.357525    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-47hc6\""
Jul 14 19:37:56.357616 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.357545    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 19:37:56.359024 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.359004    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.361558 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.361542    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.362697 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.362680    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 19:37:56.362819 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.362775    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 19:37:56.362962 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.362948    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5sk5g\""
Jul 14 19:37:56.362962 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.362956    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 19:37:56.363932 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.363914    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:56.364017 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.363980    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:37:56.365201 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.365186    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 19:37:56.365788 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.365751    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 19:37:56.365982 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.365967    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:37:56.367269 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.367255    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xnpcv\""
Jul 14 19:37:56.367612 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.367587    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 19:37:56.367721 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.367677    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 19:37:56.367957 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.367921    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 19:37:56.368093 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.367980    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zvq7f\""
Jul 14 19:37:56.368235 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.368215    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 19:37:56.368299 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.368278    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 19:37:56.368400 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.368384    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 19:37:56.423990 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.423968    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fqvz9"
Jul 14 19:37:56.435483 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.435465    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fqvz9"
Jul 14 19:37:56.439291 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.439272    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 19:37:56.449938 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.449922    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-cni-bin\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.450115 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.449944    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-hostroot\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.450115 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.449962    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:37:56.450115 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.449978    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-var-lib-kubelet\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.450115 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.449996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.450115 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-slash\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.450115 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450087    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450120    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-node-log\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450141    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-os-release\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450160    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-modprobe-d\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450189    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-kubelet\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450207    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-system-cni-dir\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450240    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450259    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1a86d2d-d43b-49ed-9358-6483ff2f8394-konnectivity-ca\") pod \"konnectivity-agent-j8v8q\" (UID: \"d1a86d2d-d43b-49ed-9358-6483ff2f8394\") " pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450273    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-os-release\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a75cc395-0853-4261-8d27-d4a7f1df5af5-cni-binary-copy\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450302    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-257px\" (UniqueName: \"kubernetes.io/projected/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-kube-api-access-257px\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450331    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-sys\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.450381 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-device-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450394    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450414    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-device-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450453    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-systemd-units\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-cni-netd\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450517    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3c660eb-9fd4-40da-a80e-18c3269f17d3-ovn-node-metrics-cert\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450541    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450541    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-var-lib-kubelet\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450582    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-conf-dir\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450612    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-sysctl-d\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71c434f7-a30f-42b1-b347-bc7d5e630991-host\") pod \"node-ca-stxdp\" (UID: \"71c434f7-a30f-42b1-b347-bc7d5e630991\") " pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450656    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-run-openvswitch\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450673    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450695    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3c660eb-9fd4-40da-a80e-18c3269f17d3-env-overrides\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-kubelet-config\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-cnibin\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.451037 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450768    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450783    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-run-netns\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450809    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9xwm\" (UniqueName: \"kubernetes.io/projected/ecc6c844-9b73-47f9-95e2-a695bb2098c9-kube-api-access-q9xwm\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450834    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1a86d2d-d43b-49ed-9358-6483ff2f8394-agent-certs\") pod \"konnectivity-agent-j8v8q\" (UID: \"d1a86d2d-d43b-49ed-9358-6483ff2f8394\") " pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450849    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/71c434f7-a30f-42b1-b347-bc7d5e630991-serviceca\") pod \"node-ca-stxdp\" (UID: \"71c434f7-a30f-42b1-b347-bc7d5e630991\") " pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450885    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2f1d400-6300-4f87-9afd-39f401c4fba9-tmp-dir\") pod \"node-resolver-wchmn\" (UID: \"c2f1d400-6300-4f87-9afd-39f401c4fba9\") " pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-run-systemd\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450936    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-run-multus-certs\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450966    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1a86d2d-d43b-49ed-9358-6483ff2f8394-konnectivity-ca\") pod \"konnectivity-agent-j8v8q\" (UID: \"d1a86d2d-d43b-49ed-9358-6483ff2f8394\") " pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.450982    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-system-cni-dir\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451034    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-cnibin\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-run-k8s-cni-cncf-io\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-var-lib-cni-bin\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451097    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-etc-kubernetes\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451124    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f8cj\" (UniqueName: \"kubernetes.io/projected/a75cc395-0853-4261-8d27-d4a7f1df5af5-kube-api-access-6f8cj\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451144    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-systemd\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.451668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-kubernetes\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451186    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-run\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451179    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh776\" (UniqueName: \"kubernetes.io/projected/9c4ae350-9e61-41de-864e-fa499316b5a4-kube-api-access-jh776\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451229    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-registration-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451246    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-host\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451260    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d20f149d-3245-4b6e-8529-0d36ff43eb46-host-slash\") pod \"iptables-alerter-nnf5s\" (UID: \"d20f149d-3245-4b6e-8529-0d36ff43eb46\") " pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451281    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-run-ovn\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451290    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-registration-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451330    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqkjx\" (UniqueName: \"kubernetes.io/projected/e3c660eb-9fd4-40da-a80e-18c3269f17d3-kube-api-access-jqkjx\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451355    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-dbus\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451371    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-var-lib-cni-multus\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-daemon-config\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451436    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-lib-modules\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451454    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-sys-fs\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451469    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451507    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:56.452282 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451540    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-sysctl-conf\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-sys-fs\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451567    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-run-netns\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451593    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-etc-openvswitch\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451621    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-socket-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451646    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d20f149d-3245-4b6e-8529-0d36ff43eb46-iptables-alerter-script\") pod \"iptables-alerter-nnf5s\" (UID: \"d20f149d-3245-4b6e-8529-0d36ff43eb46\") " pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-log-socket\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451694    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-cni-dir\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-sysconfig\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451758    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ecc6c844-9b73-47f9-95e2-a695bb2098c9-socket-dir\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451758    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-tuned\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451795    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n98pb\" (UniqueName: \"kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb\") pod \"network-check-target-lgct8\" (UID: \"b08c804c-f0b9-4f2f-839f-93d69a167f8a\") " pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqv5t\" (UniqueName: \"kubernetes.io/projected/71c434f7-a30f-42b1-b347-bc7d5e630991-kube-api-access-nqv5t\") pod \"node-ca-stxdp\" (UID: \"71c434f7-a30f-42b1-b347-bc7d5e630991\") " pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3c660eb-9fd4-40da-a80e-18c3269f17d3-ovnkube-config\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451844    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451876    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-socket-dir-parent\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.452836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451898    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5m2n\" (UniqueName: \"kubernetes.io/projected/d20f149d-3245-4b6e-8529-0d36ff43eb46-kube-api-access-m5m2n\") pod \"iptables-alerter-nnf5s\" (UID: \"d20f149d-3245-4b6e-8529-0d36ff43eb46\") " pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.453299 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451913    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-var-lib-openvswitch\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.453299 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451956    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3c660eb-9fd4-40da-a80e-18c3269f17d3-ovnkube-script-lib\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.453299 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqksc\" (UniqueName: \"kubernetes.io/projected/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-kube-api-access-tqksc\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.453299 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.451994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4ae350-9e61-41de-864e-fa499316b5a4-tmp\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.453299 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.452009    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c2f1d400-6300-4f87-9afd-39f401c4fba9-hosts-file\") pod \"node-resolver-wchmn\" (UID: \"c2f1d400-6300-4f87-9afd-39f401c4fba9\") " pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.453299 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.452033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qr58\" (UniqueName: \"kubernetes.io/projected/c2f1d400-6300-4f87-9afd-39f401c4fba9-kube-api-access-7qr58\") pod \"node-resolver-wchmn\" (UID: \"c2f1d400-6300-4f87-9afd-39f401c4fba9\") " pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.454330 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.454311    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1a86d2d-d43b-49ed-9358-6483ff2f8394-agent-certs\") pod \"konnectivity-agent-j8v8q\" (UID: \"d1a86d2d-d43b-49ed-9358-6483ff2f8394\") " pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:37:56.462443 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.462419    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9xwm\" (UniqueName: \"kubernetes.io/projected/ecc6c844-9b73-47f9-95e2-a695bb2098c9-kube-api-access-q9xwm\") pod \"aws-ebs-csi-driver-node-59nzl\" (UID: \"ecc6c844-9b73-47f9-95e2-a695bb2098c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.465806 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.465693    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 19:32:56 +0000 UTC" deadline="2028-01-23 19:56:17.448594014 +0000 UTC"
Jul 14 19:37:56.465806 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.465748    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13392h18m20.982851647s"
Jul 14 19:37:56.472027 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.472009    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:37:56.552531 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-host\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.552531 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552503    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d20f149d-3245-4b6e-8529-0d36ff43eb46-host-slash\") pod \"iptables-alerter-nnf5s\" (UID: \"d20f149d-3245-4b6e-8529-0d36ff43eb46\") " pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.552531 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552520    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-run-ovn\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.552531 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552535    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqkjx\" (UniqueName: \"kubernetes.io/projected/e3c660eb-9fd4-40da-a80e-18c3269f17d3-kube-api-access-jqkjx\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552551    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-dbus\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552566    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-var-lib-cni-multus\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-daemon-config\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552606    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d20f149d-3245-4b6e-8529-0d36ff43eb46-host-slash\") pod \"iptables-alerter-nnf5s\" (UID: \"d20f149d-3245-4b6e-8529-0d36ff43eb46\") " pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552606    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-host\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552610    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-lib-modules\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552645    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-var-lib-cni-multus\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552650    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-run-ovn\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552730    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-sysctl-conf\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552758    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-run-netns\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552785    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-etc-openvswitch\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552786    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-run-ovn-kubernetes\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552786    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-lib-modules\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552807    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-dbus\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552822    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d20f149d-3245-4b6e-8529-0d36ff43eb46-iptables-alerter-script\") pod \"iptables-alerter-nnf5s\" (UID: \"d20f149d-3245-4b6e-8529-0d36ff43eb46\") " pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.552827 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.552818    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552852    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-etc-openvswitch\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552870    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-log-socket\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552906    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-run-netns\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552925    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-log-socket\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.552933    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret podName:a3aad93b-06f9-4f52-bd2e-3602a4e4d79e nodeName:}" failed. No retries permitted until 2026-07-14 19:37:57.052890711 +0000 UTC m=+2.110410262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret") pod "global-pull-secret-syncer-lxm7p" (UID: "a3aad93b-06f9-4f52-bd2e-3602a4e4d79e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552950    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-sysctl-conf\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.552955    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-cni-dir\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553001    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-sysconfig\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553009    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-cni-dir\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553026    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-tuned\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98pb\" (UniqueName: \"kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb\") pod \"network-check-target-lgct8\" (UID: \"b08c804c-f0b9-4f2f-839f-93d69a167f8a\") " pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553058    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-sysconfig\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553078    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv5t\" (UniqueName: \"kubernetes.io/projected/71c434f7-a30f-42b1-b347-bc7d5e630991-kube-api-access-nqv5t\") pod \"node-ca-stxdp\" (UID: \"71c434f7-a30f-42b1-b347-bc7d5e630991\") " pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553103    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3c660eb-9fd4-40da-a80e-18c3269f17d3-ovnkube-config\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-socket-dir-parent\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.553713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5m2n\" (UniqueName: \"kubernetes.io/projected/d20f149d-3245-4b6e-8529-0d36ff43eb46-kube-api-access-m5m2n\") pod \"iptables-alerter-nnf5s\" (UID: \"d20f149d-3245-4b6e-8529-0d36ff43eb46\") " pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-var-lib-openvswitch\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553210    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-daemon-config\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3c660eb-9fd4-40da-a80e-18c3269f17d3-ovnkube-script-lib\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553283    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-socket-dir-parent\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553353    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-var-lib-openvswitch\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqksc\" (UniqueName: \"kubernetes.io/projected/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-kube-api-access-tqksc\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553413    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d20f149d-3245-4b6e-8529-0d36ff43eb46-iptables-alerter-script\") pod \"iptables-alerter-nnf5s\" (UID: \"d20f149d-3245-4b6e-8529-0d36ff43eb46\") " pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4ae350-9e61-41de-864e-fa499316b5a4-tmp\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c2f1d400-6300-4f87-9afd-39f401c4fba9-hosts-file\") pod \"node-resolver-wchmn\" (UID: \"c2f1d400-6300-4f87-9afd-39f401c4fba9\") " pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553510    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qr58\" (UniqueName: \"kubernetes.io/projected/c2f1d400-6300-4f87-9afd-39f401c4fba9-kube-api-access-7qr58\") pod \"node-resolver-wchmn\" (UID: \"c2f1d400-6300-4f87-9afd-39f401c4fba9\") " pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553535    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-cni-bin\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553568    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-hostroot\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-var-lib-kubelet\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553664    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-slash\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553678    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-cni-bin\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.554488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553689    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-node-log\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553715    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3c660eb-9fd4-40da-a80e-18c3269f17d3-ovnkube-config\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553727    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-hostroot\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553737    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c2f1d400-6300-4f87-9afd-39f401c4fba9-hosts-file\") pod \"node-resolver-wchmn\" (UID: \"c2f1d400-6300-4f87-9afd-39f401c4fba9\") " pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553720    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-os-release\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553791    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-var-lib-kubelet\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553796    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-slash\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553810    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-modprobe-d\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553811    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-node-log\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553847    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.553862    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553858    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-os-release\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553891    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-kubelet\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553926    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-kubelet\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.553940    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs podName:a6ae9bd7-7f8d-4959-be29-db1c428bfbe5 nodeName:}" failed. No retries permitted until 2026-07-14 19:37:57.053901171 +0000 UTC m=+2.111420690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs") pod "network-metrics-daemon-qp8f5" (UID: "a6ae9bd7-7f8d-4959-be29-db1c428bfbe5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553988    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-modprobe-d\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.553987    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-system-cni-dir\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.555348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554048    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-system-cni-dir\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554098    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554124    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-os-release\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554147    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a75cc395-0853-4261-8d27-d4a7f1df5af5-cni-binary-copy\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554164    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-257px\" (UniqueName: \"kubernetes.io/projected/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-kube-api-access-257px\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-sys\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-systemd-units\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554235    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3c660eb-9fd4-40da-a80e-18c3269f17d3-ovnkube-script-lib\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554238    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-cni-netd\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554291    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3c660eb-9fd4-40da-a80e-18c3269f17d3-ovn-node-metrics-cert\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554316    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-var-lib-kubelet\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554326    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-os-release\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554340    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-conf-dir\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554365    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-sysctl-d\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71c434f7-a30f-42b1-b347-bc7d5e630991-host\") pod \"node-ca-stxdp\" (UID: \"71c434f7-a30f-42b1-b347-bc7d5e630991\") " pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-run-openvswitch\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554422    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-sys\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.556316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554446    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554465    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-systemd-units\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554473    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3c660eb-9fd4-40da-a80e-18c3269f17d3-env-overrides\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554511    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-cni-netd\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554540    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-kubelet-config\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554568    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-cnibin\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554575    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554632    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-run-netns\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/71c434f7-a30f-42b1-b347-bc7d5e630991-host\") pod \"node-ca-stxdp\" (UID: \"71c434f7-a30f-42b1-b347-bc7d5e630991\") " pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554658    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-multus-conf-dir\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554661    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/71c434f7-a30f-42b1-b347-bc7d5e630991-serviceca\") pod \"node-ca-stxdp\" (UID: \"71c434f7-a30f-42b1-b347-bc7d5e630991\") " pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554706    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2f1d400-6300-4f87-9afd-39f401c4fba9-tmp-dir\") pod \"node-resolver-wchmn\" (UID: \"c2f1d400-6300-4f87-9afd-39f401c4fba9\") " pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554711    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-cnibin\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554733    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-run-systemd\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554783    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-sysctl-d\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554790    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a75cc395-0853-4261-8d27-d4a7f1df5af5-cni-binary-copy\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557225 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554784    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554833    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-run-multus-certs\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-system-cni-dir\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554847    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3c660eb-9fd4-40da-a80e-18c3269f17d3-env-overrides\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554910    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-run-openvswitch\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554921    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554936    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-kubelet-config\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.554983    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-run-systemd\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555033    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c660eb-9fd4-40da-a80e-18c3269f17d3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555063    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-cnibin\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555086    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-run-multus-certs\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555130    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-run-k8s-cni-cncf-io\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555136    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-cnibin\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-run-k8s-cni-cncf-io\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555176    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-var-lib-cni-bin\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-etc-kubernetes\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555231    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f8cj\" (UniqueName: \"kubernetes.io/projected/a75cc395-0853-4261-8d27-d4a7f1df5af5-kube-api-access-6f8cj\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555242    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-run-netns\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.557930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555258    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-systemd\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555285    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-kubernetes\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555303    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-system-cni-dir\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555310    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-run\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555321    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/71c434f7-a30f-42b1-b347-bc7d5e630991-serviceca\") pod \"node-ca-stxdp\" (UID: \"71c434f7-a30f-42b1-b347-bc7d5e630991\") " pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555337    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh776\" (UniqueName: \"kubernetes.io/projected/9c4ae350-9e61-41de-864e-fa499316b5a4-kube-api-access-jh776\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555385    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-var-lib-cni-bin\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555390    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-run\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555427    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-etc-kubernetes\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555468    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-kubernetes\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555472    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-systemd\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555543    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2f1d400-6300-4f87-9afd-39f401c4fba9-tmp-dir\") pod \"node-resolver-wchmn\" (UID: \"c2f1d400-6300-4f87-9afd-39f401c4fba9\") " pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555604    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a75cc395-0853-4261-8d27-d4a7f1df5af5-host-var-lib-kubelet\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555720    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9c4ae350-9e61-41de-864e-fa499316b5a4-etc-tuned\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.555884    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.556512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4ae350-9e61-41de-864e-fa499316b5a4-tmp\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.558506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.557618    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3c660eb-9fd4-40da-a80e-18c3269f17d3-ovn-node-metrics-cert\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.560954 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.560935    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:37:56.561030 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.560959    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:37:56.561030 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.560973    2569 projected.go:196] Error preparing data for projected volume kube-api-access-n98pb for pod openshift-network-diagnostics/network-check-target-lgct8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:37:56.561030 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.561028    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb podName:b08c804c-f0b9-4f2f-839f-93d69a167f8a nodeName:}" failed. No retries permitted until 2026-07-14 19:37:57.061017126 +0000 UTC m=+2.118536647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n98pb" (UniqueName: "kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb") pod "network-check-target-lgct8" (UID: "b08c804c-f0b9-4f2f-839f-93d69a167f8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:37:56.563368 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.563346    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqkjx\" (UniqueName: \"kubernetes.io/projected/e3c660eb-9fd4-40da-a80e-18c3269f17d3-kube-api-access-jqkjx\") pod \"ovnkube-node-q969l\" (UID: \"e3c660eb-9fd4-40da-a80e-18c3269f17d3\") " pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.563582 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.563560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqv5t\" (UniqueName: \"kubernetes.io/projected/71c434f7-a30f-42b1-b347-bc7d5e630991-kube-api-access-nqv5t\") pod \"node-ca-stxdp\" (UID: \"71c434f7-a30f-42b1-b347-bc7d5e630991\") " pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.564198 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.564173    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh776\" (UniqueName: \"kubernetes.io/projected/9c4ae350-9e61-41de-864e-fa499316b5a4-kube-api-access-jh776\") pod \"tuned-brkw9\" (UID: \"9c4ae350-9e61-41de-864e-fa499316b5a4\") " pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.564593 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.564570    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qr58\" (UniqueName: \"kubernetes.io/projected/c2f1d400-6300-4f87-9afd-39f401c4fba9-kube-api-access-7qr58\") pod \"node-resolver-wchmn\" (UID: \"c2f1d400-6300-4f87-9afd-39f401c4fba9\") " pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.565079 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.565059    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-257px\" (UniqueName: \"kubernetes.io/projected/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-kube-api-access-257px\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:37:56.565440 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.565422    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f8cj\" (UniqueName: \"kubernetes.io/projected/a75cc395-0853-4261-8d27-d4a7f1df5af5-kube-api-access-6f8cj\") pod \"multus-k5qgw\" (UID: \"a75cc395-0853-4261-8d27-d4a7f1df5af5\") " pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.567790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.567767    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5m2n\" (UniqueName: \"kubernetes.io/projected/d20f149d-3245-4b6e-8529-0d36ff43eb46-kube-api-access-m5m2n\") pod \"iptables-alerter-nnf5s\" (UID: \"d20f149d-3245-4b6e-8529-0d36ff43eb46\") " pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.568368 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.568348    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqksc\" (UniqueName: \"kubernetes.io/projected/c1a0f0e9-3e41-48d7-ae5a-edde773b9a28-kube-api-access-tqksc\") pod \"multus-additional-cni-plugins-8l5kq\" (UID: \"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28\") " pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.585489 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.585427    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ca441aec6f18be4b0922c5dc5643a9.slice/crio-593c1c434b48c4ab862e1f048ae2d2c0bba9c77789043b674cdf71205769fd96 WatchSource:0}: Error finding container 593c1c434b48c4ab862e1f048ae2d2c0bba9c77789043b674cdf71205769fd96: Status 404 returned error can't find the container with id 593c1c434b48c4ab862e1f048ae2d2c0bba9c77789043b674cdf71205769fd96
Jul 14 19:37:56.585950 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.585930    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a73d3955fefc5adc829bb88b76c5af2.slice/crio-b6427ccd5df6bd7b9077af178a703f898380d7080c71863fea1b3a428488f043 WatchSource:0}: Error finding container b6427ccd5df6bd7b9077af178a703f898380d7080c71863fea1b3a428488f043: Status 404 returned error can't find the container with id b6427ccd5df6bd7b9077af178a703f898380d7080c71863fea1b3a428488f043
Jul 14 19:37:56.589165 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.589146    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:37:56.669733 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.669695    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl"
Jul 14 19:37:56.679615 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.679593    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc6c844_9b73_47f9_95e2_a695bb2098c9.slice/crio-edb4eb829d9890057e27a0f50e43111feac8002d0790b5a2ee18d42014cc8c5d WatchSource:0}: Error finding container edb4eb829d9890057e27a0f50e43111feac8002d0790b5a2ee18d42014cc8c5d: Status 404 returned error can't find the container with id edb4eb829d9890057e27a0f50e43111feac8002d0790b5a2ee18d42014cc8c5d
Jul 14 19:37:56.689530 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.689505    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:37:56.698212 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.698173    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a86d2d_d43b_49ed_9358_6483ff2f8394.slice/crio-54de93abb573f4120a3702a31a2fd20cf9c7417e3479576332dff4d0228e0f63 WatchSource:0}: Error finding container 54de93abb573f4120a3702a31a2fd20cf9c7417e3479576332dff4d0228e0f63: Status 404 returned error can't find the container with id 54de93abb573f4120a3702a31a2fd20cf9c7417e3479576332dff4d0228e0f63
Jul 14 19:37:56.705407 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.705386    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8l5kq"
Jul 14 19:37:56.713985 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.713962    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a0f0e9_3e41_48d7_ae5a_edde773b9a28.slice/crio-72c99eeeaf3c0ce253b5fc67135dfdce2cf98ca24efa01147128537141d2b520 WatchSource:0}: Error finding container 72c99eeeaf3c0ce253b5fc67135dfdce2cf98ca24efa01147128537141d2b520: Status 404 returned error can't find the container with id 72c99eeeaf3c0ce253b5fc67135dfdce2cf98ca24efa01147128537141d2b520
Jul 14 19:37:56.723517 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.723499    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k5qgw"
Jul 14 19:37:56.731592 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.731573    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75cc395_0853_4261_8d27_d4a7f1df5af5.slice/crio-028b0fc1ea56fd1bad9b532c18b9665a0b801e123f41db3e1a2d7fdc9458919e WatchSource:0}: Error finding container 028b0fc1ea56fd1bad9b532c18b9665a0b801e123f41db3e1a2d7fdc9458919e: Status 404 returned error can't find the container with id 028b0fc1ea56fd1bad9b532c18b9665a0b801e123f41db3e1a2d7fdc9458919e
Jul 14 19:37:56.737792 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.737767    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-brkw9"
Jul 14 19:37:56.743982 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.743962    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-stxdp"
Jul 14 19:37:56.745838 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.745814    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4ae350_9e61_41de_864e_fa499316b5a4.slice/crio-e2f43b2024ab2f34049c3bc9941a44408eef6701808a26459b8182dfbb626727 WatchSource:0}: Error finding container e2f43b2024ab2f34049c3bc9941a44408eef6701808a26459b8182dfbb626727: Status 404 returned error can't find the container with id e2f43b2024ab2f34049c3bc9941a44408eef6701808a26459b8182dfbb626727
Jul 14 19:37:56.752569 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.752548    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c434f7_a30f_42b1_b347_bc7d5e630991.slice/crio-4ee2f04ab2a3482d9de142fe835097022342388c5eccb99997dbc6bd4d6053ac WatchSource:0}: Error finding container 4ee2f04ab2a3482d9de142fe835097022342388c5eccb99997dbc6bd4d6053ac: Status 404 returned error can't find the container with id 4ee2f04ab2a3482d9de142fe835097022342388c5eccb99997dbc6bd4d6053ac
Jul 14 19:37:56.761458 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.761441    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wchmn"
Jul 14 19:37:56.769569 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.769543    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f1d400_6300_4f87_9afd_39f401c4fba9.slice/crio-b4505052f68b63a134bc8b6217255ed044a37052980ff76eafd4395c526b8cb4 WatchSource:0}: Error finding container b4505052f68b63a134bc8b6217255ed044a37052980ff76eafd4395c526b8cb4: Status 404 returned error can't find the container with id b4505052f68b63a134bc8b6217255ed044a37052980ff76eafd4395c526b8cb4
Jul 14 19:37:56.771119 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.771099    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnf5s"
Jul 14 19:37:56.778181 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.777208    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:37:56.780202 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.780086    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20f149d_3245_4b6e_8529_0d36ff43eb46.slice/crio-4d3a478753514bca5fa83e159e2a6579ea8a18b38839c4f8d918ff0592e8ee03 WatchSource:0}: Error finding container 4d3a478753514bca5fa83e159e2a6579ea8a18b38839c4f8d918ff0592e8ee03: Status 404 returned error can't find the container with id 4d3a478753514bca5fa83e159e2a6579ea8a18b38839c4f8d918ff0592e8ee03
Jul 14 19:37:56.785393 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:37:56.785373    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c660eb_9fd4_40da_a80e_18c3269f17d3.slice/crio-14a0b56ba87699165ecfc2882644b332c9bb70e581f24157a6ddf253ace03f46 WatchSource:0}: Error finding container 14a0b56ba87699165ecfc2882644b332c9bb70e581f24157a6ddf253ace03f46: Status 404 returned error can't find the container with id 14a0b56ba87699165ecfc2882644b332c9bb70e581f24157a6ddf253ace03f46
Jul 14 19:37:56.787154 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.787133    2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container ovn-controller start failed in pod ovnkube-node-q969l_openshift-ovn-kubernetes(e3c660eb-9fd4-40da-a80e-18c3269f17d3): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 14 19:37:56.788541 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.788521    2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy-node start failed in pod ovnkube-node-q969l_openshift-ovn-kubernetes(e3c660eb-9fd4-40da-a80e-18c3269f17d3): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 14 19:37:56.791680 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:56.791638    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9d1573db16143027c8ffaf46a01ce12f2bcd89c15410c42ca54be4b3b1ddfdd6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" podUID="e3c660eb-9fd4-40da-a80e-18c3269f17d3"
Jul 14 19:37:56.869389 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:56.869335    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:37:57.059444 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.059411    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:57.059597 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.059458    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:37:57.059597 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.059560    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:37:57.059682 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.059607    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs podName:a6ae9bd7-7f8d-4959-be29-db1c428bfbe5 nodeName:}" failed. No retries permitted until 2026-07-14 19:37:58.059591463 +0000 UTC m=+3.117110983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs") pod "network-metrics-daemon-qp8f5" (UID: "a6ae9bd7-7f8d-4959-be29-db1c428bfbe5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:37:57.059682 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.059560    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:37:57.059799 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.059720    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret podName:a3aad93b-06f9-4f52-bd2e-3602a4e4d79e nodeName:}" failed. No retries permitted until 2026-07-14 19:37:58.059692229 +0000 UTC m=+3.117211752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret") pod "global-pull-secret-syncer-lxm7p" (UID: "a3aad93b-06f9-4f52-bd2e-3602a4e4d79e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:37:57.160349 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.160280    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98pb\" (UniqueName: \"kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb\") pod \"network-check-target-lgct8\" (UID: \"b08c804c-f0b9-4f2f-839f-93d69a167f8a\") " pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:37:57.160492 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.160453    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:37:57.160492 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.160475    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:37:57.160492 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.160488    2569 projected.go:196] Error preparing data for projected volume kube-api-access-n98pb for pod openshift-network-diagnostics/network-check-target-lgct8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:37:57.160613 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.160546    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb podName:b08c804c-f0b9-4f2f-839f-93d69a167f8a nodeName:}" failed. No retries permitted until 2026-07-14 19:37:58.160527871 +0000 UTC m=+3.218047405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n98pb" (UniqueName: "kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb") pod "network-check-target-lgct8" (UID: "b08c804c-f0b9-4f2f-839f-93d69a167f8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:37:57.439322 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.439211    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 19:32:57 +0000 UTC" deadline="2028-01-13 06:50:16.816839528 +0000 UTC"
Jul 14 19:37:57.439322 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.439274    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13139h12m19.377569327s"
Jul 14 19:37:57.442218 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.442189    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:57.442348 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.442323    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:37:57.448056 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.447957    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-brkw9" event={"ID":"9c4ae350-9e61-41de-864e-fa499316b5a4","Type":"ContainerStarted","Data":"e2f43b2024ab2f34049c3bc9941a44408eef6701808a26459b8182dfbb626727"}
Jul 14 19:37:57.453042 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.453011    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l5kq" event={"ID":"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28","Type":"ContainerStarted","Data":"72c99eeeaf3c0ce253b5fc67135dfdce2cf98ca24efa01147128537141d2b520"}
Jul 14 19:37:57.460238 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.460212    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl" event={"ID":"ecc6c844-9b73-47f9-95e2-a695bb2098c9","Type":"ContainerStarted","Data":"edb4eb829d9890057e27a0f50e43111feac8002d0790b5a2ee18d42014cc8c5d"}
Jul 14 19:37:57.466589 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.466563    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" event={"ID":"e3c660eb-9fd4-40da-a80e-18c3269f17d3","Type":"ContainerStarted","Data":"14a0b56ba87699165ecfc2882644b332c9bb70e581f24157a6ddf253ace03f46"}
Jul 14 19:37:57.469689 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.469509    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnf5s" event={"ID":"d20f149d-3245-4b6e-8529-0d36ff43eb46","Type":"ContainerStarted","Data":"4d3a478753514bca5fa83e159e2a6579ea8a18b38839c4f8d918ff0592e8ee03"}
Jul 14 19:37:57.474299 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.474155    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-stxdp" event={"ID":"71c434f7-a30f-42b1-b347-bc7d5e630991","Type":"ContainerStarted","Data":"4ee2f04ab2a3482d9de142fe835097022342388c5eccb99997dbc6bd4d6053ac"}
Jul 14 19:37:57.479098 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.479063    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k5qgw" event={"ID":"a75cc395-0853-4261-8d27-d4a7f1df5af5","Type":"ContainerStarted","Data":"028b0fc1ea56fd1bad9b532c18b9665a0b801e123f41db3e1a2d7fdc9458919e"}
Jul 14 19:37:57.483967 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.483900    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9d1573db16143027c8ffaf46a01ce12f2bcd89c15410c42ca54be4b3b1ddfdd6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9d1573db16143027c8ffaf46a01ce12f2bcd89c15410c42ca54be4b3b1ddfdd6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" podUID="e3c660eb-9fd4-40da-a80e-18c3269f17d3"
Jul 14 19:37:57.484283 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.484260    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j8v8q" event={"ID":"d1a86d2d-d43b-49ed-9358-6483ff2f8394","Type":"ContainerStarted","Data":"54de93abb573f4120a3702a31a2fd20cf9c7417e3479576332dff4d0228e0f63"}
Jul 14 19:37:57.486795 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.486771    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal" event={"ID":"e9ca441aec6f18be4b0922c5dc5643a9","Type":"ContainerStarted","Data":"593c1c434b48c4ab862e1f048ae2d2c0bba9c77789043b674cdf71205769fd96"}
Jul 14 19:37:57.488648 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.488620    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal" event={"ID":"4a73d3955fefc5adc829bb88b76c5af2","Type":"ContainerStarted","Data":"b6427ccd5df6bd7b9077af178a703f898380d7080c71863fea1b3a428488f043"}
Jul 14 19:37:57.496312 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:57.496289    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wchmn" event={"ID":"c2f1d400-6300-4f87-9afd-39f401c4fba9","Type":"ContainerStarted","Data":"b4505052f68b63a134bc8b6217255ed044a37052980ff76eafd4395c526b8cb4"}
Jul 14 19:37:57.860841 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.860724    2569 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:81e3f2576c5145aebf33f0a2d300aef8b70217b00c31101b55ed112e7e2d0087"
Jul 14 19:37:57.861019 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.860892    2569 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-wchmn_openshift-dns(c2f1d400-6300-4f87-9afd-39f401c4fba9): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 14 19:37:57.861019 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:57.860941    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-dns/node-resolver-wchmn" podUID="c2f1d400-6300-4f87-9afd-39f401c4fba9"
Jul 14 19:37:58.069424 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:58.069388    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:37:58.069595 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:58.069475    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:58.069665 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.069616    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:37:58.069755 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.069679    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret podName:a3aad93b-06f9-4f52-bd2e-3602a4e4d79e nodeName:}" failed. No retries permitted until 2026-07-14 19:38:00.069660611 +0000 UTC m=+5.127180130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret") pod "global-pull-secret-syncer-lxm7p" (UID: "a3aad93b-06f9-4f52-bd2e-3602a4e4d79e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:37:58.069755 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.069724    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:37:58.069887 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.069783    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs podName:a6ae9bd7-7f8d-4959-be29-db1c428bfbe5 nodeName:}" failed. No retries permitted until 2026-07-14 19:38:00.069769899 +0000 UTC m=+5.127289424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs") pod "network-metrics-daemon-qp8f5" (UID: "a6ae9bd7-7f8d-4959-be29-db1c428bfbe5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:37:58.170416 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:58.170380    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98pb\" (UniqueName: \"kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb\") pod \"network-check-target-lgct8\" (UID: \"b08c804c-f0b9-4f2f-839f-93d69a167f8a\") " pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:37:58.170593 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.170543    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:37:58.170593 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.170575    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:37:58.170593 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.170590    2569 projected.go:196] Error preparing data for projected volume kube-api-access-n98pb for pod openshift-network-diagnostics/network-check-target-lgct8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:37:58.170803 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.170653    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb podName:b08c804c-f0b9-4f2f-839f-93d69a167f8a nodeName:}" failed. No retries permitted until 2026-07-14 19:38:00.170634556 +0000 UTC m=+5.228154078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n98pb" (UniqueName: "kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb") pod "network-check-target-lgct8" (UID: "b08c804c-f0b9-4f2f-839f-93d69a167f8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:37:58.439360 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:58.439279    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:37:58.439855 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.439416    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:37:58.439855 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:58.439519    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:37:58.439855 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.439611    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:37:58.439855 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:58.439824    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 19:32:57 +0000 UTC" deadline="2027-12-12 09:06:19.582662083 +0000 UTC"
Jul 14 19:37:58.439855 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:58.439847    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12373h28m21.142819453s"
Jul 14 19:37:58.501751 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:58.501703    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:81e3f2576c5145aebf33f0a2d300aef8b70217b00c31101b55ed112e7e2d0087\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-dns/node-resolver-wchmn" podUID="c2f1d400-6300-4f87-9afd-39f401c4fba9"
Jul 14 19:37:58.811223 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:58.811005    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 19:37:59.439861 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:37:59.439331    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:37:59.439861 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:37:59.439463    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:00.089434 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:00.089122    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:00.089434 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:00.089218    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:00.089434 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:00.089308    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:38:00.089434 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:00.089356    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:38:00.089434 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:00.089385    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs podName:a6ae9bd7-7f8d-4959-be29-db1c428bfbe5 nodeName:}" failed. No retries permitted until 2026-07-14 19:38:04.089362735 +0000 UTC m=+9.146882275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs") pod "network-metrics-daemon-qp8f5" (UID: "a6ae9bd7-7f8d-4959-be29-db1c428bfbe5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:38:00.089434 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:00.089410    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret podName:a3aad93b-06f9-4f52-bd2e-3602a4e4d79e nodeName:}" failed. No retries permitted until 2026-07-14 19:38:04.089393579 +0000 UTC m=+9.146913113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret") pod "global-pull-secret-syncer-lxm7p" (UID: "a3aad93b-06f9-4f52-bd2e-3602a4e4d79e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:38:00.190570 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:00.190150    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98pb\" (UniqueName: \"kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb\") pod \"network-check-target-lgct8\" (UID: \"b08c804c-f0b9-4f2f-839f-93d69a167f8a\") " pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:00.190570 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:00.190337    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:38:00.190570 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:00.190358    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:38:00.190570 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:00.190372    2569 projected.go:196] Error preparing data for projected volume kube-api-access-n98pb for pod openshift-network-diagnostics/network-check-target-lgct8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:38:00.190570 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:00.190430    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb podName:b08c804c-f0b9-4f2f-839f-93d69a167f8a nodeName:}" failed. No retries permitted until 2026-07-14 19:38:04.190411893 +0000 UTC m=+9.247931416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n98pb" (UniqueName: "kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb") pod "network-check-target-lgct8" (UID: "b08c804c-f0b9-4f2f-839f-93d69a167f8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:38:00.439066 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:00.439034    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:00.439262 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:00.439171    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:00.439628 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:00.439607    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:00.439740 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:00.439720    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:01.439842 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:01.439809    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:01.440473 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:01.439957    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:02.439109 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:02.439076    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:02.439320 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:02.439213    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:02.439320 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:02.439288    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:02.439457 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:02.439424    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:03.439969 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:03.439932    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:03.440440 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:03.440086    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:04.122558 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:04.122523    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:04.122759 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:04.122591    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:04.122759 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:04.122729    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:38:04.122903 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:04.122856    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs podName:a6ae9bd7-7f8d-4959-be29-db1c428bfbe5 nodeName:}" failed. No retries permitted until 2026-07-14 19:38:12.122771787 +0000 UTC m=+17.180291307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs") pod "network-metrics-daemon-qp8f5" (UID: "a6ae9bd7-7f8d-4959-be29-db1c428bfbe5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:38:04.123095 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:04.123070    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:38:04.123223 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:04.123142    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret podName:a3aad93b-06f9-4f52-bd2e-3602a4e4d79e nodeName:}" failed. No retries permitted until 2026-07-14 19:38:12.123124065 +0000 UTC m=+17.180643595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret") pod "global-pull-secret-syncer-lxm7p" (UID: "a3aad93b-06f9-4f52-bd2e-3602a4e4d79e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:38:04.224095 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:04.223989    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98pb\" (UniqueName: \"kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb\") pod \"network-check-target-lgct8\" (UID: \"b08c804c-f0b9-4f2f-839f-93d69a167f8a\") " pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:04.224282 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:04.224161    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:38:04.224282 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:04.224191    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:38:04.224282 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:04.224208    2569 projected.go:196] Error preparing data for projected volume kube-api-access-n98pb for pod openshift-network-diagnostics/network-check-target-lgct8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:38:04.224429 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:04.224283    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb podName:b08c804c-f0b9-4f2f-839f-93d69a167f8a nodeName:}" failed. No retries permitted until 2026-07-14 19:38:12.224266752 +0000 UTC m=+17.281786286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n98pb" (UniqueName: "kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb") pod "network-check-target-lgct8" (UID: "b08c804c-f0b9-4f2f-839f-93d69a167f8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:38:04.439816 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:04.439707    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:04.439816 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:04.439755    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:04.440020 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:04.439863    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:04.440378 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:04.440014    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:05.443296 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:05.443267    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:05.443714 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:05.443367    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:06.439270 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:06.439230    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:06.439475 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:06.439253    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:06.439475 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:06.439370    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:06.439475 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:06.439411    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:07.439905 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:07.439725    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:07.440295 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:07.440013    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:08.438957 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:08.438909    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:08.439128 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:08.439039    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:08.439128 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:08.439098    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:08.439238 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:08.439217    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:09.439188 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:09.439150    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:09.439594 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:09.439281    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:10.439668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:10.439634    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:10.440115 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:10.439750    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:10.440115 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:10.439843    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:10.440115 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:10.439951    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:10.525831 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:10.525800    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k5qgw" event={"ID":"a75cc395-0853-4261-8d27-d4a7f1df5af5","Type":"ContainerStarted","Data":"b9e767c9de1adeffe5d8d71b5f3d07a79a10e85ef6244b98060d9a307e5dcc19"}
Jul 14 19:38:10.527533 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:10.527505    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal" event={"ID":"e9ca441aec6f18be4b0922c5dc5643a9","Type":"ContainerStarted","Data":"60700d667658991fb5200a56ce68ebbf6cc5726ee998dbde3d231855d5321dd7"}
Jul 14 19:38:10.530316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:10.530284    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-brkw9" event={"ID":"9c4ae350-9e61-41de-864e-fa499316b5a4","Type":"ContainerStarted","Data":"eebb92f946d5f72b16f19594b18627b08439ed689fd6144dadb447f5a9bef561"}
Jul 14 19:38:10.546926 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:10.546889    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k5qgw" podStartSLOduration=1.037283218 podStartE2EDuration="14.546876388s" totalImagesPullingTime="13.50959317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:10.546789365 +0000 UTC m=+15.604308905" watchObservedRunningTime="2026-07-14 19:38:10.546876388 +0000 UTC m=+15.604395967"
Jul 14 19:38:10.567561 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:10.565587    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-brkw9" podStartSLOduration=1.312420804 podStartE2EDuration="14.565296651s" totalImagesPullingTime="13.252875847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:10.564847413 +0000 UTC m=+15.622366963" watchObservedRunningTime="2026-07-14 19:38:10.565296651 +0000 UTC m=+15.622816194"
Jul 14 19:38:10.583354 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:10.583318    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-12.ec2.internal" podStartSLOduration=13.583305426999999 podStartE2EDuration="13.583305427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:10.583123283 +0000 UTC m=+15.640642823" watchObservedRunningTime="2026-07-14 19:38:10.583305427 +0000 UTC m=+15.640824965"
Jul 14 19:38:11.439616 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.439461    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:11.439736 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:11.439716    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:11.533361 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.533330    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j8v8q" event={"ID":"d1a86d2d-d43b-49ed-9358-6483ff2f8394","Type":"ContainerStarted","Data":"f8a3ef4a0be760f9b32865b3db0066bed26c88280917509d1aa061fb5793fe03"}
Jul 14 19:38:11.534641 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.534618    2569 generic.go:356] "Generic (PLEG): container finished" podID="4a73d3955fefc5adc829bb88b76c5af2" containerID="246e26bfdbae7898eaa97b4ac30774910c5ee40a7a79d996364e1e5906d24bd8" exitCode=0
Jul 14 19:38:11.534754 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.534690    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal" event={"ID":"4a73d3955fefc5adc829bb88b76c5af2","Type":"ContainerDied","Data":"246e26bfdbae7898eaa97b4ac30774910c5ee40a7a79d996364e1e5906d24bd8"}
Jul 14 19:38:11.536048 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.536013    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wchmn" event={"ID":"c2f1d400-6300-4f87-9afd-39f401c4fba9","Type":"ContainerStarted","Data":"c49857cf63f9eaae49db586119346a60b088dfa535002c3e0f325c172f499900"}
Jul 14 19:38:11.537423 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.537396    2569 generic.go:356] "Generic (PLEG): container finished" podID="c1a0f0e9-3e41-48d7-ae5a-edde773b9a28" containerID="00761ee764de54ae56e449aeb8a1ae239297e0474e6efb498838ee165b15aeec" exitCode=0
Jul 14 19:38:11.537501 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.537460    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l5kq" event={"ID":"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28","Type":"ContainerDied","Data":"00761ee764de54ae56e449aeb8a1ae239297e0474e6efb498838ee165b15aeec"}
Jul 14 19:38:11.538754 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.538729    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl" event={"ID":"ecc6c844-9b73-47f9-95e2-a695bb2098c9","Type":"ContainerStarted","Data":"194fc23f6747702f57cfe7b3f09caa62c0ccb0e867faef446c146a52573be4ac"}
Jul 14 19:38:11.540239 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.540221    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnf5s" event={"ID":"d20f149d-3245-4b6e-8529-0d36ff43eb46","Type":"ContainerStarted","Data":"a750fbe262e805172a84890ebcf21b67dca5e8cc45efe97ba7c2db5001bcf638"}
Jul 14 19:38:11.541500 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.541452    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-stxdp" event={"ID":"71c434f7-a30f-42b1-b347-bc7d5e630991","Type":"ContainerStarted","Data":"d76c9061ca2dd877dd91c3aa5be949a063231b60a27555c2febda759af6ac30d"}
Jul 14 19:38:11.552220 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.552161    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j8v8q" podStartSLOduration=2.356782664 podStartE2EDuration="15.552148885s" totalImagesPullingTime="13.195366221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:11.551830982 +0000 UTC m=+16.609350521" watchObservedRunningTime="2026-07-14 19:38:11.552148885 +0000 UTC m=+16.609668424"
Jul 14 19:38:11.619078 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.619033    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-stxdp" podStartSLOduration=2.172499076 podStartE2EDuration="15.619019323s" totalImagesPullingTime="13.446520247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:11.598967546 +0000 UTC m=+16.656487085" watchObservedRunningTime="2026-07-14 19:38:11.619019323 +0000 UTC m=+16.676538863"
Jul 14 19:38:11.644402 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.644366    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wchmn" podStartSLOduration=15.644351132 podStartE2EDuration="15.644351132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-14 19:38:11.620927771 +0000 UTC m=+16.678447310" watchObservedRunningTime="2026-07-14 19:38:11.644351132 +0000 UTC m=+16.701870672"
Jul 14 19:38:11.644518 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:11.644489    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nnf5s" podStartSLOduration=2.466225921 podStartE2EDuration="15.644481075s" totalImagesPullingTime="13.178255154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:11.643913797 +0000 UTC m=+16.701433360" watchObservedRunningTime="2026-07-14 19:38:11.644481075 +0000 UTC m=+16.702000616"
Jul 14 19:38:12.184708 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:12.184658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:12.184882 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:12.184742    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:12.184882 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:12.184810    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:38:12.184882 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:12.184855    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:38:12.185025 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:12.184884    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret podName:a3aad93b-06f9-4f52-bd2e-3602a4e4d79e nodeName:}" failed. No retries permitted until 2026-07-14 19:38:28.184857176 +0000 UTC m=+33.242376709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret") pod "global-pull-secret-syncer-lxm7p" (UID: "a3aad93b-06f9-4f52-bd2e-3602a4e4d79e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:38:12.185025 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:12.184910    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs podName:a6ae9bd7-7f8d-4959-be29-db1c428bfbe5 nodeName:}" failed. No retries permitted until 2026-07-14 19:38:28.184894663 +0000 UTC m=+33.242414181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs") pod "network-metrics-daemon-qp8f5" (UID: "a6ae9bd7-7f8d-4959-be29-db1c428bfbe5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:38:12.285918 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:12.285888    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98pb\" (UniqueName: \"kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb\") pod \"network-check-target-lgct8\" (UID: \"b08c804c-f0b9-4f2f-839f-93d69a167f8a\") " pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:12.286123 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:12.286057    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:38:12.286123 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:12.286079    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:38:12.286123 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:12.286091    2569 projected.go:196] Error preparing data for projected volume kube-api-access-n98pb for pod openshift-network-diagnostics/network-check-target-lgct8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:38:12.286225 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:12.286134    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb podName:b08c804c-f0b9-4f2f-839f-93d69a167f8a nodeName:}" failed. No retries permitted until 2026-07-14 19:38:28.286121535 +0000 UTC m=+33.343641056 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n98pb" (UniqueName: "kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb") pod "network-check-target-lgct8" (UID: "b08c804c-f0b9-4f2f-839f-93d69a167f8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:38:12.439968 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:12.439904    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:12.439968 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:12.439924    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:12.440565 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:12.439982    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:12.440565 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:12.440032    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:12.544336 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:12.544307    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal" event={"ID":"4a73d3955fefc5adc829bb88b76c5af2","Type":"ContainerStarted","Data":"69ab29f635e385b690a7d1f59661393e548b8458a377585b99399ddb81626b3a"}
Jul 14 19:38:13.439506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:13.439472    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:13.439710 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:13.439605    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:13.823183 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:13.822997    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 19:38:14.416877 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:14.416745    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T19:38:13.823167315Z","UUID":"1bb3cdd3-bfd5-4890-bc2f-45ea53fcd6e6","Handler":null,"Name":"","Endpoint":""}
Jul 14 19:38:14.418685 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:14.418663    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 19:38:14.418832 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:14.418722    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 19:38:14.436560 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:14.436535    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:38:14.437453 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:14.437345    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:38:14.440402 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:14.439832    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:14.440402 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:14.439964    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:14.440402 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:14.440284    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:14.440402 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:14.440370    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:14.482012 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:14.481940    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-12.ec2.internal" podStartSLOduration=17.481920688 podStartE2EDuration="17.481920688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:12.562104023 +0000 UTC m=+17.619623562" watchObservedRunningTime="2026-07-14 19:38:14.481920688 +0000 UTC m=+19.539440232"
Jul 14 19:38:14.552481 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:14.552446    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl" event={"ID":"ecc6c844-9b73-47f9-95e2-a695bb2098c9","Type":"ContainerStarted","Data":"513426144b5b928b5251f0441607fffa52afce8b639de31c97f6ebde5caf1061"}
Jul 14 19:38:15.441096 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:15.441066    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:15.441530 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:15.441195    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:16.439403 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:16.439367    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:16.439403 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:16.439389    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:16.439617 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:16.439499    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:16.439743 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:16.439717    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:17.439456 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:17.439422    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:17.440001 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:17.439671    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:18.439817 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:18.439779    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:18.440319 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:18.439886    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:18.440319 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:18.439915    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:18.440319 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:18.439970    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:18.562310 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:18.562273    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl" event={"ID":"ecc6c844-9b73-47f9-95e2-a695bb2098c9","Type":"ContainerStarted","Data":"70cbb0dd9f72d8effd61e4ca2fdaef8fd244eba4ac8338bf69c3bb99f439fe6c"}
Jul 14 19:38:18.564319 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:18.564281    2569 generic.go:356] "Generic (PLEG): container finished" podID="c1a0f0e9-3e41-48d7-ae5a-edde773b9a28" containerID="617b146c72d96fb2dfef9a77d8c5cb11d0a8741ecbca65a9f20d1c235ea7332f" exitCode=0
Jul 14 19:38:18.564446 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:18.564322    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l5kq" event={"ID":"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28","Type":"ContainerDied","Data":"617b146c72d96fb2dfef9a77d8c5cb11d0a8741ecbca65a9f20d1c235ea7332f"}
Jul 14 19:38:18.601640 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:18.601593    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-59nzl" podStartSLOduration=3.287614805 podStartE2EDuration="22.601580437s" totalImagesPullingTime="19.313965632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:18.60127772 +0000 UTC m=+23.658797272" watchObservedRunningTime="2026-07-14 19:38:18.601580437 +0000 UTC m=+23.659099977"
Jul 14 19:38:19.439714 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:19.439663    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:19.439901 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:19.439781    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:20.439887 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:20.439856    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:20.440047 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:20.439864    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:20.440047 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:20.439966    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:20.440047 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:20.440036    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:21.438938 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:21.438907    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:21.439134 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:21.439038    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:22.439237 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:22.439204    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:22.439656 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:22.439204    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:22.439656 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:22.439334    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:22.439656 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:22.439412    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:23.439846 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:23.439808    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:23.440347 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:23.439945    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:24.439484 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:24.439460    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:24.439592 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:24.439492    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:24.439592 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:24.439574    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:24.439729 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:24.439678    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:24.577058 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:24.577033    2569 generic.go:356] "Generic (PLEG): container finished" podID="c1a0f0e9-3e41-48d7-ae5a-edde773b9a28" containerID="e59bad993e51e7a6933fe4a097374efa2db933ddced4d76b403f02d71906cf76" exitCode=0
Jul 14 19:38:24.577472 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:24.577122    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l5kq" event={"ID":"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28","Type":"ContainerDied","Data":"e59bad993e51e7a6933fe4a097374efa2db933ddced4d76b403f02d71906cf76"}
Jul 14 19:38:24.579141 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:24.579121    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:38:24.579687 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:24.579505    2569 generic.go:356] "Generic (PLEG): container finished" podID="e3c660eb-9fd4-40da-a80e-18c3269f17d3" containerID="88fce14345bd72ed35c2888a7da89070a855ff746a69fc31a3f77335f57196cf" exitCode=1
Jul 14 19:38:24.579687 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:24.579556    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" event={"ID":"e3c660eb-9fd4-40da-a80e-18c3269f17d3","Type":"ContainerDied","Data":"88fce14345bd72ed35c2888a7da89070a855ff746a69fc31a3f77335f57196cf"}
Jul 14 19:38:24.579687 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:24.579627    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" event={"ID":"e3c660eb-9fd4-40da-a80e-18c3269f17d3","Type":"ContainerStarted","Data":"e96e2f196fea008bb1e7d91479c4012581b26506b235223834ef65c319f351be"}
Jul 14 19:38:25.439539 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:25.439505    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:25.439732 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:25.439595    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:25.584492 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:25.584470    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:38:25.585119 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:25.584844    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" event={"ID":"e3c660eb-9fd4-40da-a80e-18c3269f17d3","Type":"ContainerStarted","Data":"3462dbccc114c7133f2e253118d6fcb8b65553168416a8febfc11cf7118ded65"}
Jul 14 19:38:25.585119 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:25.584928    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" event={"ID":"e3c660eb-9fd4-40da-a80e-18c3269f17d3","Type":"ContainerStarted","Data":"d694b947cd331e48031cae1263ebd48e7e9b350453d53a0a09aec7fa4c334e0b"}
Jul 14 19:38:25.585119 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:25.584980    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" event={"ID":"e3c660eb-9fd4-40da-a80e-18c3269f17d3","Type":"ContainerStarted","Data":"98f09114117a246f7edc98266b3988f6f6440de2073dc71273f8f1747d3874e7"}
Jul 14 19:38:25.585119 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:25.585032    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" event={"ID":"e3c660eb-9fd4-40da-a80e-18c3269f17d3","Type":"ContainerStarted","Data":"1e5fcbe1fe2ccfbd14116e05188d05d8e87785b120cb227f6fbd6eb3fb278369"}
Jul 14 19:38:25.680982 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:25.680962    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:38:25.681077 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:25.681064    2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 14 19:38:25.681622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:25.681594    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j8v8q"
Jul 14 19:38:26.439191 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:26.439165    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:26.439357 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:26.439257    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:26.439357 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:26.439252    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:26.439357 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:26.439338    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:26.589691 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:26.589660    2569 generic.go:356] "Generic (PLEG): container finished" podID="c1a0f0e9-3e41-48d7-ae5a-edde773b9a28" containerID="c56f6f8335997a98848f38c5ff4dccee008bdd15eec547b37c858077c852542b" exitCode=0
Jul 14 19:38:26.590133 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:26.589733    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l5kq" event={"ID":"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28","Type":"ContainerDied","Data":"c56f6f8335997a98848f38c5ff4dccee008bdd15eec547b37c858077c852542b"}
Jul 14 19:38:27.439286 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:27.439255    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:27.439456 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:27.439381    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:27.595929 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:27.595903    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:38:27.596354 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:27.596308    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" event={"ID":"e3c660eb-9fd4-40da-a80e-18c3269f17d3","Type":"ContainerStarted","Data":"397a08ba4f3dc9653dd66df74fcc04a67628b53b01acf9ce99dfc05010c2c037"}
Jul 14 19:38:28.199122 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:28.199086    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:28.199302 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:28.199153    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:28.199302 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:28.199246    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:38:28.199418 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:28.199311    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs podName:a6ae9bd7-7f8d-4959-be29-db1c428bfbe5 nodeName:}" failed. No retries permitted until 2026-07-14 19:39:00.199290804 +0000 UTC m=+65.256810339 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs") pod "network-metrics-daemon-qp8f5" (UID: "a6ae9bd7-7f8d-4959-be29-db1c428bfbe5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 19:38:28.199418 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:28.199249    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 19:38:28.199418 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:28.199397    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret podName:a3aad93b-06f9-4f52-bd2e-3602a4e4d79e nodeName:}" failed. No retries permitted until 2026-07-14 19:39:00.199379366 +0000 UTC m=+65.256898902 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret") pod "global-pull-secret-syncer-lxm7p" (UID: "a3aad93b-06f9-4f52-bd2e-3602a4e4d79e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 19:38:28.300074 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:28.300039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98pb\" (UniqueName: \"kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb\") pod \"network-check-target-lgct8\" (UID: \"b08c804c-f0b9-4f2f-839f-93d69a167f8a\") " pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:28.300243 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:28.300175    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 19:38:28.300243 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:28.300195    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 19:38:28.300243 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:28.300207    2569 projected.go:196] Error preparing data for projected volume kube-api-access-n98pb for pod openshift-network-diagnostics/network-check-target-lgct8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:38:28.300354 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:28.300259    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb podName:b08c804c-f0b9-4f2f-839f-93d69a167f8a nodeName:}" failed. No retries permitted until 2026-07-14 19:39:00.300247018 +0000 UTC m=+65.357766535 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n98pb" (UniqueName: "kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb") pod "network-check-target-lgct8" (UID: "b08c804c-f0b9-4f2f-839f-93d69a167f8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 19:38:28.439389 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:28.439358    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:28.439554 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:28.439360    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:28.439554 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:28.439453    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:28.439631 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:28.439552    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:29.439785 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:29.439707    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:29.440173 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:29.439840    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:30.439878 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:30.439843    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:30.439878 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:30.439861    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:30.440521 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:30.439972    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:30.440521 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:30.440074    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:30.606505 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:30.606358    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:38:30.606841 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:30.606820    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" event={"ID":"e3c660eb-9fd4-40da-a80e-18c3269f17d3","Type":"ContainerStarted","Data":"ee8751d6d114e4cff7158376686c2584fd9c5472bc549f28420fda3f85cad743"}
Jul 14 19:38:30.607093 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:30.607075    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:38:30.607219 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:30.607143    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:38:30.607269 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:30.607243    2569 scope.go:117] "RemoveContainer" containerID="88fce14345bd72ed35c2888a7da89070a855ff746a69fc31a3f77335f57196cf"
Jul 14 19:38:30.624539 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:30.624514    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:38:31.439336 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:31.439303    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:31.439498 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:31.439416    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:31.611778 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:31.611745    2569 generic.go:356] "Generic (PLEG): container finished" podID="c1a0f0e9-3e41-48d7-ae5a-edde773b9a28" containerID="65ec5b4e6ea9cfc20adf6972bdb880fcb6347f981622c00e75f4b8b423771e90" exitCode=0
Jul 14 19:38:31.612228 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:31.611831    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l5kq" event={"ID":"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28","Type":"ContainerDied","Data":"65ec5b4e6ea9cfc20adf6972bdb880fcb6347f981622c00e75f4b8b423771e90"}
Jul 14 19:38:31.615509 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:31.615486    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:38:31.615881 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:31.615849    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" event={"ID":"e3c660eb-9fd4-40da-a80e-18c3269f17d3","Type":"ContainerStarted","Data":"8e4ca4599d3ec004ab775dfee2706f26aec8a5f26debfd1416c849ee3394f77b"}
Jul 14 19:38:31.616119 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:31.616069    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:38:31.632665 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:31.632646    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:38:31.675533 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:31.675484    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q969l" podStartSLOduration=8.162006005 podStartE2EDuration="35.675466496s" totalImagesPullingTime="27.513460491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=2 observedRunningTime="2026-07-14 19:38:31.674961229 +0000 UTC m=+36.732480768" watchObservedRunningTime="2026-07-14 19:38:31.675466496 +0000 UTC m=+36.732986036"
Jul 14 19:38:32.438984 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:32.438953    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:32.438984 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:32.438974    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:32.439146 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:32.439050    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:32.439194 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:32.439174    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:32.621272 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:32.621245    2569 generic.go:356] "Generic (PLEG): container finished" podID="c1a0f0e9-3e41-48d7-ae5a-edde773b9a28" containerID="6d96556cfea15482225d66a7ba04127ca5efa8e70d9e3a521dafb1019fc12ef6" exitCode=0
Jul 14 19:38:32.621597 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:32.621327    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l5kq" event={"ID":"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28","Type":"ContainerDied","Data":"6d96556cfea15482225d66a7ba04127ca5efa8e70d9e3a521dafb1019fc12ef6"}
Jul 14 19:38:32.807620 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:32.807472    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lgct8"]
Jul 14 19:38:32.807746 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:32.807691    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:32.807800 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:32.807784    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:32.810802 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:32.810756    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qp8f5"]
Jul 14 19:38:32.810906 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:32.810883    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:32.811013 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:32.810990    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:32.811420 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:32.811400    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lxm7p"]
Jul 14 19:38:32.811484 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:32.811473    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:32.811551 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:32.811536    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:33.627500 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:33.627470    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l5kq" event={"ID":"c1a0f0e9-3e41-48d7-ae5a-edde773b9a28","Type":"ContainerStarted","Data":"0c4d8acde068151e2e282cb79f1cb058ee96daf775d3f86a3384b44fc5155351"}
Jul 14 19:38:33.654190 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:33.654148    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8l5kq" podStartSLOduration=7.639336162 podStartE2EDuration="37.654133764s" totalImagesPullingTime="30.014797602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:33.653252677 +0000 UTC m=+38.710772219" watchObservedRunningTime="2026-07-14 19:38:33.654133764 +0000 UTC m=+38.711653651"
Jul 14 19:38:33.850968 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:33.850936    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:33.957578 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:33.957506    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:34.439141 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:34.439111    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:34.439141 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:34.439133    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:34.439374 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:34.439149    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:34.439374 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:34.439222    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:34.439374 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:34.439268    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:34.439374 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:34.439349    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:36.405167 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.405135    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:36.439832 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.439781    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:36.439832 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.439802    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:36.439963 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.439781    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:36.439963 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:36.439894    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:38:36.439963 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:36.439937    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lxm7p" podUID="a3aad93b-06f9-4f52-bd2e-3602a4e4d79e"
Jul 14 19:38:36.440051 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:36.440009    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lgct8" podUID="b08c804c-f0b9-4f2f-839f-93d69a167f8a"
Jul 14 19:38:36.504104 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.504070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:36.595140 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.595111    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:36.758795 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.758730    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-12.ec2.internal" event="NodeReady"
Jul 14 19:38:36.758913 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.758854    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 19:38:36.810138 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.810112    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-smbdz"]
Jul 14 19:38:36.831132 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.831110    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ww5zf"]
Jul 14 19:38:36.831232 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.831218    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:36.835058 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.835030    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-774zx\""
Jul 14 19:38:36.835058 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.835043    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 19:38:36.835296 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.835273    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 19:38:36.843649 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.843632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-smbdz"]
Jul 14 19:38:36.843762 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.843659    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ww5zf"]
Jul 14 19:38:36.843803 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.843760    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ww5zf"
Jul 14 19:38:36.847386 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.847372    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 19:38:36.847642 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.847630    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 19:38:36.847941 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.847922    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 19:38:36.848223 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.848208    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cpr6w\""
Jul 14 19:38:36.967417 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.967390    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdf0ad82-65fb-40ac-9729-fcade69a2cde-cert\") pod \"ingress-canary-ww5zf\" (UID: \"bdf0ad82-65fb-40ac-9729-fcade69a2cde\") " pod="openshift-ingress-canary/ingress-canary-ww5zf"
Jul 14 19:38:36.967417 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.967419    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwfjt\" (UniqueName: \"kubernetes.io/projected/bdf0ad82-65fb-40ac-9729-fcade69a2cde-kube-api-access-qwfjt\") pod \"ingress-canary-ww5zf\" (UID: \"bdf0ad82-65fb-40ac-9729-fcade69a2cde\") " pod="openshift-ingress-canary/ingress-canary-ww5zf"
Jul 14 19:38:36.967613 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.967437    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f3189cc-6793-417a-9aa9-9674b1b6f793-config-volume\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:36.967613 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.967455    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f3189cc-6793-417a-9aa9-9674b1b6f793-tmp-dir\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:36.967613 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.967481    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:36.967613 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:36.967581    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h62d2\" (UniqueName: \"kubernetes.io/projected/4f3189cc-6793-417a-9aa9-9674b1b6f793-kube-api-access-h62d2\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:37.068592 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.068528    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdf0ad82-65fb-40ac-9729-fcade69a2cde-cert\") pod \"ingress-canary-ww5zf\" (UID: \"bdf0ad82-65fb-40ac-9729-fcade69a2cde\") " pod="openshift-ingress-canary/ingress-canary-ww5zf"
Jul 14 19:38:37.068592 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.068561    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwfjt\" (UniqueName: \"kubernetes.io/projected/bdf0ad82-65fb-40ac-9729-fcade69a2cde-kube-api-access-qwfjt\") pod \"ingress-canary-ww5zf\" (UID: \"bdf0ad82-65fb-40ac-9729-fcade69a2cde\") " pod="openshift-ingress-canary/ingress-canary-ww5zf"
Jul 14 19:38:37.068592 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.068578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f3189cc-6793-417a-9aa9-9674b1b6f793-config-volume\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:37.068854 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.068630    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f3189cc-6793-417a-9aa9-9674b1b6f793-tmp-dir\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:37.068854 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.068685    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:37.068854 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.068768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h62d2\" (UniqueName: \"kubernetes.io/projected/4f3189cc-6793-417a-9aa9-9674b1b6f793-kube-api-access-h62d2\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:37.068995 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:37.068895    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:38:37.068995 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:37.068951    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls podName:4f3189cc-6793-417a-9aa9-9674b1b6f793 nodeName:}" failed. No retries permitted until 2026-07-14 19:38:37.568936457 +0000 UTC m=+42.626455976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls") pod "dns-default-smbdz" (UID: "4f3189cc-6793-417a-9aa9-9674b1b6f793") : secret "dns-default-metrics-tls" not found
Jul 14 19:38:37.069106 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.069006    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f3189cc-6793-417a-9aa9-9674b1b6f793-tmp-dir\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:37.069216 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.069197    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f3189cc-6793-417a-9aa9-9674b1b6f793-config-volume\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:37.072885 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.072859    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdf0ad82-65fb-40ac-9729-fcade69a2cde-cert\") pod \"ingress-canary-ww5zf\" (UID: \"bdf0ad82-65fb-40ac-9729-fcade69a2cde\") " pod="openshift-ingress-canary/ingress-canary-ww5zf"
Jul 14 19:38:37.079078 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.079058    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h62d2\" (UniqueName: \"kubernetes.io/projected/4f3189cc-6793-417a-9aa9-9674b1b6f793-kube-api-access-h62d2\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:37.079304 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.079288    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwfjt\" (UniqueName: \"kubernetes.io/projected/bdf0ad82-65fb-40ac-9729-fcade69a2cde-kube-api-access-qwfjt\") pod \"ingress-canary-ww5zf\" (UID: \"bdf0ad82-65fb-40ac-9729-fcade69a2cde\") " pod="openshift-ingress-canary/ingress-canary-ww5zf"
Jul 14 19:38:37.151385 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.151355    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ww5zf"
Jul 14 19:38:37.240633 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.240599    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:37.347522 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.347263    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ww5zf"]
Jul 14 19:38:37.350891 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:38:37.350862    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdf0ad82_65fb_40ac_9729_fcade69a2cde.slice/crio-785873490ec022c6ac77e1ea9d9436884c981c358f00f98d007c3d81cbc476e1 WatchSource:0}: Error finding container 785873490ec022c6ac77e1ea9d9436884c981c358f00f98d007c3d81cbc476e1: Status 404 returned error can't find the container with id 785873490ec022c6ac77e1ea9d9436884c981c358f00f98d007c3d81cbc476e1
Jul 14 19:38:37.490525 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.490471    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:37.564224 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.564193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:37.574410 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.574389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:37.574501 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:37.574490    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:38:37.574546 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:37.574537    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls podName:4f3189cc-6793-417a-9aa9-9674b1b6f793 nodeName:}" failed. No retries permitted until 2026-07-14 19:38:38.574524276 +0000 UTC m=+43.632043794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls") pod "dns-default-smbdz" (UID: "4f3189cc-6793-417a-9aa9-9674b1b6f793") : secret "dns-default-metrics-tls" not found
Jul 14 19:38:37.637870 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:37.637845    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ww5zf" event={"ID":"bdf0ad82-65fb-40ac-9729-fcade69a2cde","Type":"ContainerStarted","Data":"785873490ec022c6ac77e1ea9d9436884c981c358f00f98d007c3d81cbc476e1"}
Jul 14 19:38:38.439733 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:38.439684    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:38:38.439733 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:38.439723    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:38:38.439733 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:38.439737    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:38:38.443851 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:38.443774    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 19:38:38.443851 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:38.443828    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9cvvf\""
Jul 14 19:38:38.443851 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:38.443781    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 19:38:38.444061 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:38.443781    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 19:38:38.444246 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:38.444224    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cb2f5\""
Jul 14 19:38:38.444246 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:38.444236    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 19:38:38.581530 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:38.581490    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:38.582002 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:38.581673    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:38:38.582002 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:38.581764    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls podName:4f3189cc-6793-417a-9aa9-9674b1b6f793 nodeName:}" failed. No retries permitted until 2026-07-14 19:38:40.581743896 +0000 UTC m=+45.639263414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls") pod "dns-default-smbdz" (UID: "4f3189cc-6793-417a-9aa9-9674b1b6f793") : secret "dns-default-metrics-tls" not found
Jul 14 19:38:40.595349 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:40.595320    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:40.595811 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:40.595428    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:38:40.595811 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:40.595478    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls podName:4f3189cc-6793-417a-9aa9-9674b1b6f793 nodeName:}" failed. No retries permitted until 2026-07-14 19:38:44.595464111 +0000 UTC m=+49.652983629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls") pod "dns-default-smbdz" (UID: "4f3189cc-6793-417a-9aa9-9674b1b6f793") : secret "dns-default-metrics-tls" not found
Jul 14 19:38:40.646009 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:40.645977    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ww5zf" event={"ID":"bdf0ad82-65fb-40ac-9729-fcade69a2cde","Type":"ContainerStarted","Data":"19328717265a8d14d789bb0581f13529b18bf8b1cdad04db13451f6a85f846d3"}
Jul 14 19:38:40.665032 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:40.664959    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ww5zf" podStartSLOduration=1.9779843129999999 podStartE2EDuration="4.664939262s" totalImagesPullingTime="2.686954949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:40.66376445 +0000 UTC m=+45.721283990" watchObservedRunningTime="2026-07-14 19:38:40.664939262 +0000 UTC m=+45.722458802"
Jul 14 19:38:44.167673 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:44.167641    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:44.265591 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:44.265562    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:44.622163 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:44.622134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:44.622295 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:44.622252    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:38:44.622337 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:44.622301    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls podName:4f3189cc-6793-417a-9aa9-9674b1b6f793 nodeName:}" failed. No retries permitted until 2026-07-14 19:38:52.622289166 +0000 UTC m=+57.679808685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls") pod "dns-default-smbdz" (UID: "4f3189cc-6793-417a-9aa9-9674b1b6f793") : secret "dns-default-metrics-tls" not found
Jul 14 19:38:45.489352 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:45.489319    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:45.607234 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:45.607201    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:45.679440 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:45.679409    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:46.629025 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:46.628991    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:46.708256 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:46.708228    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:48.513246 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:48.513215    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:51.037454 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.037418    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"]
Jul 14 19:38:51.039107 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.039090    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.044127 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.044106    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 19:38:51.045396 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.045379    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 14 19:38:51.046733 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.046714    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 19:38:51.046788 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.046743    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 19:38:51.050339 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.050322    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"]
Jul 14 19:38:51.052128 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.052114    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.055590 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.055568    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 14 19:38:51.055652 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.055589    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 14 19:38:51.055652 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.055575    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 14 19:38:51.055652 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.055617    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 14 19:38:51.060189 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.060171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-hub\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.060279 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.060231    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-ca\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.060279 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.060273    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l54gh\" (UniqueName: \"kubernetes.io/projected/b82c48ac-3975-4b26-b8c8-2baa1df22c86-kube-api-access-l54gh\") pod \"klusterlet-addon-workmgr-75df7fb545-ts9xc\" (UID: \"b82c48ac-3975-4b26-b8c8-2baa1df22c86\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.060373 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.060297    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e402558e-3f9c-4f59-9eb8-2f683da2b704-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.060373 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.060333    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.060373 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.060357    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b82c48ac-3975-4b26-b8c8-2baa1df22c86-klusterlet-config\") pod \"klusterlet-addon-workmgr-75df7fb545-ts9xc\" (UID: \"b82c48ac-3975-4b26-b8c8-2baa1df22c86\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.060481 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.060380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.060481 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.060406    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b82c48ac-3975-4b26-b8c8-2baa1df22c86-tmp\") pod \"klusterlet-addon-workmgr-75df7fb545-ts9xc\" (UID: \"b82c48ac-3975-4b26-b8c8-2baa1df22c86\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.060481 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.060423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jngmr\" (UniqueName: \"kubernetes.io/projected/e402558e-3f9c-4f59-9eb8-2f683da2b704-kube-api-access-jngmr\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.069020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.068997    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"]
Jul 14 19:38:51.074108 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.074088    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"]
Jul 14 19:38:51.161336 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.161309    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.161465 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.161350    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b82c48ac-3975-4b26-b8c8-2baa1df22c86-tmp\") pod \"klusterlet-addon-workmgr-75df7fb545-ts9xc\" (UID: \"b82c48ac-3975-4b26-b8c8-2baa1df22c86\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.161465 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.161369    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jngmr\" (UniqueName: \"kubernetes.io/projected/e402558e-3f9c-4f59-9eb8-2f683da2b704-kube-api-access-jngmr\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.161465 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.161386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-hub\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.161465 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.161432    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-ca\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.161465 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.161455    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l54gh\" (UniqueName: \"kubernetes.io/projected/b82c48ac-3975-4b26-b8c8-2baa1df22c86-kube-api-access-l54gh\") pod \"klusterlet-addon-workmgr-75df7fb545-ts9xc\" (UID: \"b82c48ac-3975-4b26-b8c8-2baa1df22c86\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.161755 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.161477    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e402558e-3f9c-4f59-9eb8-2f683da2b704-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.161755 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.161527    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.161755 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.161561    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b82c48ac-3975-4b26-b8c8-2baa1df22c86-klusterlet-config\") pod \"klusterlet-addon-workmgr-75df7fb545-ts9xc\" (UID: \"b82c48ac-3975-4b26-b8c8-2baa1df22c86\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.161755 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.161744    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b82c48ac-3975-4b26-b8c8-2baa1df22c86-tmp\") pod \"klusterlet-addon-workmgr-75df7fb545-ts9xc\" (UID: \"b82c48ac-3975-4b26-b8c8-2baa1df22c86\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.162463 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.162299    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e402558e-3f9c-4f59-9eb8-2f683da2b704-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.165199 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.165175    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.165362 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.165340    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-ca\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.165414 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.165360    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b82c48ac-3975-4b26-b8c8-2baa1df22c86-klusterlet-config\") pod \"klusterlet-addon-workmgr-75df7fb545-ts9xc\" (UID: \"b82c48ac-3975-4b26-b8c8-2baa1df22c86\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.165414 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.165406    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.165687 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.165672    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e402558e-3f9c-4f59-9eb8-2f683da2b704-hub\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.174127 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.174109    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l54gh\" (UniqueName: \"kubernetes.io/projected/b82c48ac-3975-4b26-b8c8-2baa1df22c86-kube-api-access-l54gh\") pod \"klusterlet-addon-workmgr-75df7fb545-ts9xc\" (UID: \"b82c48ac-3975-4b26-b8c8-2baa1df22c86\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.174424 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.174404    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jngmr\" (UniqueName: \"kubernetes.io/projected/e402558e-3f9c-4f59-9eb8-2f683da2b704-kube-api-access-jngmr\") pod \"cluster-proxy-proxy-agent-5565f9f5c7-29pf7\" (UID: \"e402558e-3f9c-4f59-9eb8-2f683da2b704\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.348305 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.348234    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:51.376314 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.376291    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:38:51.496678 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.496651    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"]
Jul 14 19:38:51.499736 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:38:51.499688    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82c48ac_3975_4b26_b8c8_2baa1df22c86.slice/crio-e4e9a5d2332cbc0d97b7702eaca7408dbd834fcda90c3d65b2580c9e2efd2520 WatchSource:0}: Error finding container e4e9a5d2332cbc0d97b7702eaca7408dbd834fcda90c3d65b2580c9e2efd2520: Status 404 returned error can't find the container with id e4e9a5d2332cbc0d97b7702eaca7408dbd834fcda90c3d65b2580c9e2efd2520
Jul 14 19:38:51.527081 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.527058    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"]
Jul 14 19:38:51.529938 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:38:51.529915    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode402558e_3f9c_4f59_9eb8_2f683da2b704.slice/crio-d04580c3ffacf253c8cde314e10707a506d44554df17c75675c3ae351c9c19f9 WatchSource:0}: Error finding container d04580c3ffacf253c8cde314e10707a506d44554df17c75675c3ae351c9c19f9: Status 404 returned error can't find the container with id d04580c3ffacf253c8cde314e10707a506d44554df17c75675c3ae351c9c19f9
Jul 14 19:38:51.672082 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.672050    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" event={"ID":"e402558e-3f9c-4f59-9eb8-2f683da2b704","Type":"ContainerStarted","Data":"d04580c3ffacf253c8cde314e10707a506d44554df17c75675c3ae351c9c19f9"}
Jul 14 19:38:51.673050 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:51.673028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" event={"ID":"b82c48ac-3975-4b26-b8c8-2baa1df22c86","Type":"ContainerStarted","Data":"e4e9a5d2332cbc0d97b7702eaca7408dbd834fcda90c3d65b2580c9e2efd2520"}
Jul 14 19:38:52.673332 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:52.673299    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:38:52.673845 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:52.673430    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:38:52.673845 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:38:52.673501    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls podName:4f3189cc-6793-417a-9aa9-9674b1b6f793 nodeName:}" failed. No retries permitted until 2026-07-14 19:39:08.673480016 +0000 UTC m=+73.730999553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls") pod "dns-default-smbdz" (UID: "4f3189cc-6793-417a-9aa9-9674b1b6f793") : secret "dns-default-metrics-tls" not found
Jul 14 19:38:57.692239 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:57.692207    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" event={"ID":"e402558e-3f9c-4f59-9eb8-2f683da2b704","Type":"ContainerStarted","Data":"89ed54276b9ab37e052decdeb961c54241bf548e76b3379d199f30c8ca725356"}
Jul 14 19:38:57.692580 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:57.692255    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" event={"ID":"e402558e-3f9c-4f59-9eb8-2f683da2b704","Type":"ContainerStarted","Data":"649d1ae7a10c3204b787cfef2bc3c543c141dcfcf513a4f6dcd29c0a0b68987a"}
Jul 14 19:38:57.693514 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:57.693492    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" event={"ID":"b82c48ac-3975-4b26-b8c8-2baa1df22c86","Type":"ContainerStarted","Data":"1816d42393a048c0eec123d4a283bfcbbfb795df8ef8bdc2dc00239861282949"}
Jul 14 19:38:57.693717 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:57.693681    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:57.695047 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:57.695027    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:38:57.711384 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:57.711347    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" podStartSLOduration=0.765820791 podStartE2EDuration="6.711336418s" totalImagesPullingTime="5.945515627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:57.710737969 +0000 UTC m=+62.768257509" watchObservedRunningTime="2026-07-14 19:38:57.711336418 +0000 UTC m=+62.768855936"
Jul 14 19:38:58.384529 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:58.384496    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:58.460358 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:58.460321    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:38:58.698342 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:58.698254    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" event={"ID":"e402558e-3f9c-4f59-9eb8-2f683da2b704","Type":"ContainerStarted","Data":"6b7bc4f5e1eac2a64810f3e8c7732f2a1ae81b86dcc723be0cc7635b5e3e7aba"}
Jul 14 19:38:58.719245 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:38:58.719199    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" podStartSLOduration=1.817567007 podStartE2EDuration="7.719184923s" totalImagesPullingTime="5.901617916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:38:58.718153012 +0000 UTC m=+63.775672554" watchObservedRunningTime="2026-07-14 19:38:58.719184923 +0000 UTC m=+63.776704512"
Jul 14 19:39:00.227746 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.227710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:39:00.228112 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.227771    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:39:00.230319 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.230296    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 19:39:00.230451 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.230351    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 19:39:00.238453 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:39:00.238434    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 19:39:00.238522 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:39:00.238499    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs podName:a6ae9bd7-7f8d-4959-be29-db1c428bfbe5 nodeName:}" failed. No retries permitted until 2026-07-14 19:40:04.238477983 +0000 UTC m=+129.295997518 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs") pod "network-metrics-daemon-qp8f5" (UID: "a6ae9bd7-7f8d-4959-be29-db1c428bfbe5") : secret "metrics-daemon-secret" not found
Jul 14 19:39:00.240526 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.240509    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a3aad93b-06f9-4f52-bd2e-3602a4e4d79e-original-pull-secret\") pod \"global-pull-secret-syncer-lxm7p\" (UID: \"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e\") " pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:39:00.328309 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.328284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98pb\" (UniqueName: \"kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb\") pod \"network-check-target-lgct8\" (UID: \"b08c804c-f0b9-4f2f-839f-93d69a167f8a\") " pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:39:00.331299 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.331282    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 19:39:00.341155 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.341137    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 19:39:00.351895 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.351877    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n98pb\" (UniqueName: \"kubernetes.io/projected/b08c804c-f0b9-4f2f-839f-93d69a167f8a-kube-api-access-n98pb\") pod \"network-check-target-lgct8\" (UID: \"b08c804c-f0b9-4f2f-839f-93d69a167f8a\") " pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:39:00.358668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.358651    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lxm7p"
Jul 14 19:39:00.506587 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.506446    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lxm7p"]
Jul 14 19:39:00.508875 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:39:00.508843    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3aad93b_06f9_4f52_bd2e_3602a4e4d79e.slice/crio-e328fc196c07d86258adaf7b1a684468b4eee100d203de484ff75c724a29b617 WatchSource:0}: Error finding container e328fc196c07d86258adaf7b1a684468b4eee100d203de484ff75c724a29b617: Status 404 returned error can't find the container with id e328fc196c07d86258adaf7b1a684468b4eee100d203de484ff75c724a29b617
Jul 14 19:39:00.654142 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.654121    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cb2f5\""
Jul 14 19:39:00.662273 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.662248    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:39:00.707581 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.707554    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lxm7p" event={"ID":"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e","Type":"ContainerStarted","Data":"e328fc196c07d86258adaf7b1a684468b4eee100d203de484ff75c724a29b617"}
Jul 14 19:39:00.805626 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:00.805596    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lgct8"]
Jul 14 19:39:00.808922 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:39:00.808896    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08c804c_f0b9_4f2f_839f_93d69a167f8a.slice/crio-0a3f477c1647d2a4d73ea6c832799a5e3f5e42dbdf9d5e74b65d497b6ae0e518 WatchSource:0}: Error finding container 0a3f477c1647d2a4d73ea6c832799a5e3f5e42dbdf9d5e74b65d497b6ae0e518: Status 404 returned error can't find the container with id 0a3f477c1647d2a4d73ea6c832799a5e3f5e42dbdf9d5e74b65d497b6ae0e518
Jul 14 19:39:01.196788 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:01.196747    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:39:01.295012 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:01.294941    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:39:01.712054 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:01.711998    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lgct8" event={"ID":"b08c804c-f0b9-4f2f-839f-93d69a167f8a","Type":"ContainerStarted","Data":"0a3f477c1647d2a4d73ea6c832799a5e3f5e42dbdf9d5e74b65d497b6ae0e518"}
Jul 14 19:39:03.531431 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:03.531394    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:39:03.639921 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:03.639891    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q969l"
Jul 14 19:39:03.650155 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:03.650129    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:39:03.873038 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:03.873007    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:39:03.948172 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:03.948140    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:39:04.645064 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:04.645027    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:39:04.722434 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:04.722403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:39:05.725304 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:05.725271    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lxm7p" event={"ID":"a3aad93b-06f9-4f52-bd2e-3602a4e4d79e","Type":"ContainerStarted","Data":"2433e587cc1874b203b7a700f6392a7253d985e642ea52ca29b2aaff2e935e91"}
Jul 14 19:39:05.726617 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:05.726595    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lgct8" event={"ID":"b08c804c-f0b9-4f2f-839f-93d69a167f8a","Type":"ContainerStarted","Data":"a80727fa2dda642abf87d3238f1158f90e0a9099561f8f70661dfd43378c76e8"}
Jul 14 19:39:05.726747 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:05.726731    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:39:05.741419 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:05.741381    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lxm7p" podStartSLOduration=64.975562862 podStartE2EDuration="1m9.74136821s" totalImagesPullingTime="4.765805348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:39:05.74087354 +0000 UTC m=+70.798393092" watchObservedRunningTime="2026-07-14 19:39:05.74136821 +0000 UTC m=+70.798887728"
Jul 14 19:39:05.758850 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:05.758815    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lgct8" podStartSLOduration=65.296769084 podStartE2EDuration="1m9.758803894s" totalImagesPullingTime="4.46203481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:39:05.75793127 +0000 UTC m=+70.815450810" watchObservedRunningTime="2026-07-14 19:39:05.758803894 +0000 UTC m=+70.816323434"
Jul 14 19:39:08.687861 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:08.687824    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:39:08.688325 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:39:08.687967    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:39:08.688325 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:39:08.688029    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls podName:4f3189cc-6793-417a-9aa9-9674b1b6f793 nodeName:}" failed. No retries permitted until 2026-07-14 19:39:40.688013989 +0000 UTC m=+105.745533507 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls") pod "dns-default-smbdz" (UID: "4f3189cc-6793-417a-9aa9-9674b1b6f793") : secret "dns-default-metrics-tls" not found
Jul 14 19:39:27.619746 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:27.619622    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:39:27.721209 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:27.721181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:39:36.731462 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:36.731428    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lgct8"
Jul 14 19:39:40.697899 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:39:40.697863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:39:40.698273 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:39:40.697977    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:39:40.698273 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:39:40.698029    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls podName:4f3189cc-6793-417a-9aa9-9674b1b6f793 nodeName:}" failed. No retries permitted until 2026-07-14 19:40:44.698014924 +0000 UTC m=+169.755534442 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls") pod "dns-default-smbdz" (UID: "4f3189cc-6793-417a-9aa9-9674b1b6f793") : secret "dns-default-metrics-tls" not found
Jul 14 19:40:04.244677 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:04.244618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:40:04.245194 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:40:04.244786    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 19:40:04.245194 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:40:04.244860    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs podName:a6ae9bd7-7f8d-4959-be29-db1c428bfbe5 nodeName:}" failed. No retries permitted until 2026-07-14 19:42:06.244843783 +0000 UTC m=+251.302363303 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs") pod "network-metrics-daemon-qp8f5" (UID: "a6ae9bd7-7f8d-4959-be29-db1c428bfbe5") : secret "metrics-daemon-secret" not found
Jul 14 19:40:30.201584 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:30.201550    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:40:39.841182 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:40:39.841141    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-smbdz" podUID="4f3189cc-6793-417a-9aa9-9674b1b6f793"
Jul 14 19:40:39.993161 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:39.993135    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smbdz"
Jul 14 19:40:41.464922 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:40:41.464880    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qp8f5" podUID="a6ae9bd7-7f8d-4959-be29-db1c428bfbe5"
Jul 14 19:40:44.717385 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:44.717349    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:40:44.717759 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:40:44.717486    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 19:40:44.717759 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:40:44.717556    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls podName:4f3189cc-6793-417a-9aa9-9674b1b6f793 nodeName:}" failed. No retries permitted until 2026-07-14 19:42:46.71754141 +0000 UTC m=+291.775060928 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls") pod "dns-default-smbdz" (UID: "4f3189cc-6793-417a-9aa9-9674b1b6f793") : secret "dns-default-metrics-tls" not found
Jul 14 19:40:54.439838 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:54.439755    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:40:57.694634 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:57.694588    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" podUID="b82c48ac-3975-4b26-b8c8-2baa1df22c86" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/readyz\": dial tcp 10.132.0.8:8000: connect: connection refused"
Jul 14 19:40:58.049863 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:58.049834    2569 generic.go:356] "Generic (PLEG): container finished" podID="b82c48ac-3975-4b26-b8c8-2baa1df22c86" containerID="1816d42393a048c0eec123d4a283bfcbbfb795df8ef8bdc2dc00239861282949" exitCode=1
Jul 14 19:40:58.050008 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:58.049870    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" event={"ID":"b82c48ac-3975-4b26-b8c8-2baa1df22c86","Type":"ContainerDied","Data":"1816d42393a048c0eec123d4a283bfcbbfb795df8ef8bdc2dc00239861282949"}
Jul 14 19:40:58.050163 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:58.050151    2569 scope.go:117] "RemoveContainer" containerID="1816d42393a048c0eec123d4a283bfcbbfb795df8ef8bdc2dc00239861282949"
Jul 14 19:40:59.054103 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:59.054068    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" event={"ID":"b82c48ac-3975-4b26-b8c8-2baa1df22c86","Type":"ContainerStarted","Data":"f3fe94052ae6758cc3d5ef772ebb748944f595fe2409492d2a608dd8d1f0d156"}
Jul 14 19:40:59.054462 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:59.054370    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:40:59.054992 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:40:59.054974    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:41:37.576215 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:37.576147    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:37.661082 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:37.661055    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:39.999369 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:39.999338    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:40.068903 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:40.068858    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:42.502603 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.502571    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w7xqb"]
Jul 14 19:41:42.505475 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.505459    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.514544 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.514524    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 19:41:42.514780 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.514761    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 19:41:42.515469 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.515456    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 19:41:42.515504 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.515475    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rt2ws\""
Jul 14 19:41:42.516340 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.516326    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 19:41:42.593307 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.593281    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.593407 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.593323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g2lj\" (UniqueName: \"kubernetes.io/projected/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-api-access-8g2lj\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.593446 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.593411    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-crio-socket\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.593446 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.593434    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-data-volume\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.593512 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.593449    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.643890 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.643871    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7xqb"]
Jul 14 19:41:42.694391 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.694365    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g2lj\" (UniqueName: \"kubernetes.io/projected/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-api-access-8g2lj\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.694493 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.694408    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-crio-socket\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.694493 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.694430    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-data-volume\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.694493 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.694448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.694615 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:42.694498    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:41:42.694615 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.694542    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.694615 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:42.694591    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:41:43.194573603 +0000 UTC m=+228.252093121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : configmap "kube-rbac-proxy" not found
Jul 14 19:41:42.694615 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.694497    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-crio-socket\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.694796 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.694713    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-data-volume\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.694796 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:42.694753    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:42.694857 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:42.694806    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:41:43.194785098 +0000 UTC m=+228.252304630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:42.705952 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.705924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:42.727861 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.727838    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g2lj\" (UniqueName: \"kubernetes.io/projected/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-api-access-8g2lj\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:42.852224 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:42.852164    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:43.037484 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:43.037456    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:43.119825 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:43.119761    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:43.197713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:43.197673    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:43.197827 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:43.197727    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:43.197827 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:43.197770    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:41:43.197827 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:43.197819    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:43.197926 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:43.197829    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:41:44.197814961 +0000 UTC m=+229.255334479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : configmap "kube-rbac-proxy" not found
Jul 14 19:41:43.197926 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:43.197866    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:41:44.197854524 +0000 UTC m=+229.255374043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:43.415126 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:43.415101    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:43.519076 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:43.519022    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:43.810550 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:43.810494    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:43.939084 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:43.939057    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:44.205629 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:44.205597    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:44.205837 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:44.205658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:44.205837 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:44.205740    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:41:44.205837 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:44.205787    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:41:46.205774896 +0000 UTC m=+231.263294415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : configmap "kube-rbac-proxy" not found
Jul 14 19:41:44.205837 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:44.205786    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:44.206001 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:44.205854    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:41:46.20583696 +0000 UTC m=+231.263356478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:44.506941 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:44.506866    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wchmn_c2f1d400-6300-4f87-9afd-39f401c4fba9/dns-node-resolver/0.log"
Jul 14 19:41:45.194900 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:45.194866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:45.286639 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:45.286608    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:45.508752 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:45.508666    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-stxdp_71c434f7-a30f-42b1-b347-bc7d5e630991/node-ca/0.log"
Jul 14 19:41:46.220491 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:46.220459    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:46.220871 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:46.220501    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:46.220871 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:46.220568    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:41:46.220871 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:46.220594    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:46.220871 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:46.220625    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:41:50.220608958 +0000 UTC m=+235.278128477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : configmap "kube-rbac-proxy" not found
Jul 14 19:41:46.220871 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:46.220641    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:41:50.220630887 +0000 UTC m=+235.278150406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:46.502213 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:46.502140    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ww5zf_bdf0ad82-65fb-40ac-9729-fcade69a2cde/serve-healthcheck-canary/0.log"
Jul 14 19:41:47.990369 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:47.990340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:48.538713 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:48.538670    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:48.771918 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:48.771882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:48.932441 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:48.932409    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:49.664354 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:49.664325    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:49.892101 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:49.892074    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:50.211913 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:50.211883    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:50.250046 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:50.250023    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:50.250133 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:50.250065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:50.250170 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:50.250132    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 19:41:50.250202 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:50.250171    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:50.250202 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:50.250186    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:41:58.250172751 +0000 UTC m=+243.307692273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : configmap "kube-rbac-proxy" not found
Jul 14 19:41:50.250275 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:50.250211    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:41:58.250197985 +0000 UTC m=+243.307717503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:50.401364 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:50.401338    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:50.624829 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:50.624801    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:51.014058 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:51.013978    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:52.972972 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:52.972936    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:53.053126 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:53.053098    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:54.726386 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:54.726352    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:54.826785 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:54.826756    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:55.004684 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:55.004610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:56.240134 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:56.240102    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:56.311215 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:56.311181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:56.800319 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:56.800286    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:57.005135 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:57.005103    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:57.199147 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:57.199119    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:57.405075 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:57.405042    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:57.605602 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:57.605523    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:58.308239 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:58.308206    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:58.308404 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:58.308255    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:58.308404 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:58.308363    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:58.308473 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:41:58.308418    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls podName:fcd3593b-6bd6-42c3-bb47-ddefa4f472ad nodeName:}" failed. No retries permitted until 2026-07-14 19:42:14.308404758 +0000 UTC m=+259.365924275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w7xqb" (UID: "fcd3593b-6bd6-42c3-bb47-ddefa4f472ad") : secret "insights-runtime-extractor-tls" not found
Jul 14 19:41:58.308749 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:58.308732    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:41:58.619439 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:58.619358    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:58.815787 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:58.815755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:59.041759 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:59.041732    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:41:59.226979 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:41:59.226952    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:00.767785 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:00.767757    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:03.904712 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:03.904661    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:04.004964 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:04.004934    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:04.076556 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:04.076517    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:04.206002 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:04.205918    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:04.581085 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:04.580973    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:04.775735 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:04.775685    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:04.844930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:04.844838    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:04.998534 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:04.998509    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:05.191738 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:05.191709    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:05.295602 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:05.295580    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:05.403125 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:05.403096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:05.591047 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:05.590947    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:06.031639 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:06.031604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:06.262400 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:06.262368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:42:06.264553 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:06.264524    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6ae9bd7-7f8d-4959-be29-db1c428bfbe5-metrics-certs\") pod \"network-metrics-daemon-qp8f5\" (UID: \"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5\") " pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:42:06.443261 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:06.443237    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9cvvf\""
Jul 14 19:42:06.450962 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:06.450938    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qp8f5"
Jul 14 19:42:06.575838 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:06.575807    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qp8f5"]
Jul 14 19:42:06.578901 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:42:06.578877    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ae9bd7_7f8d_4959_be29_db1c428bfbe5.slice/crio-d7dec2299bcf6df3f546c3273ad10fe24a5f78b1b6fab057cc158481dbdc31e1 WatchSource:0}: Error finding container d7dec2299bcf6df3f546c3273ad10fe24a5f78b1b6fab057cc158481dbdc31e1: Status 404 returned error can't find the container with id d7dec2299bcf6df3f546c3273ad10fe24a5f78b1b6fab057cc158481dbdc31e1
Jul 14 19:42:06.808974 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:06.808887    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:06.908552 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:06.908520    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:07.251057 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:07.251020    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qp8f5" event={"ID":"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5","Type":"ContainerStarted","Data":"d7dec2299bcf6df3f546c3273ad10fe24a5f78b1b6fab057cc158481dbdc31e1"}
Jul 14 19:42:07.535532 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:07.535429    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:07.661645 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:07.661577    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:07.836361 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:07.836290    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:08.255425 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:08.255392    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qp8f5" event={"ID":"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5","Type":"ContainerStarted","Data":"c5b4ee45a4ffd93652fb1e6c43aa47f555604a0f9cc489b3993319e9123a3552"}
Jul 14 19:42:08.255821 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:08.255448    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qp8f5" event={"ID":"a6ae9bd7-7f8d-4959-be29-db1c428bfbe5","Type":"ContainerStarted","Data":"8dbfe94f0147ea31114064c512f4074bd142638602293a868d3629fa88474524"}
Jul 14 19:42:08.278444 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:08.278400    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qp8f5" podStartSLOduration=251.225114289 podStartE2EDuration="4m12.278385992s" totalImagesPullingTime="1.053271703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:08.277106031 +0000 UTC m=+253.334625572" watchObservedRunningTime="2026-07-14 19:42:08.278385992 +0000 UTC m=+253.335905531"
Jul 14 19:42:08.414804 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:08.414773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:08.514643 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:08.514567    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:08.589261 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:08.589234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:12.139019 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:12.138990    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:12.241486 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:12.241457    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:12.468918 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:12.468833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:12.569721 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:12.569681    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:12.659495 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:12.659461    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:13.861120 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:13.861089    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:13.924861 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:13.924836    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:14.317858 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:14.317825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:42:14.320055 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:14.320035    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fcd3593b-6bd6-42c3-bb47-ddefa4f472ad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w7xqb\" (UID: \"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad\") " pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:42:14.617186 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:14.617114    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rt2ws\""
Jul 14 19:42:14.625492 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:14.625472    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w7xqb"
Jul 14 19:42:14.749386 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:14.749356    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w7xqb"]
Jul 14 19:42:14.752201 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:42:14.752161    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd3593b_6bd6_42c3_bb47_ddefa4f472ad.slice/crio-d3e9e8cf38eb0a78f7b820fc52c42f132ea359f30badbf0426f03e89a9a7f7e8 WatchSource:0}: Error finding container d3e9e8cf38eb0a78f7b820fc52c42f132ea359f30badbf0426f03e89a9a7f7e8: Status 404 returned error can't find the container with id d3e9e8cf38eb0a78f7b820fc52c42f132ea359f30badbf0426f03e89a9a7f7e8
Jul 14 19:42:15.276370 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:15.276332    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7xqb" event={"ID":"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad","Type":"ContainerStarted","Data":"d3e9e8cf38eb0a78f7b820fc52c42f132ea359f30badbf0426f03e89a9a7f7e8"}
Jul 14 19:42:15.666903 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:15.666858    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:15.754320 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:15.754269    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:15.830412 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:15.830377    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:19.008581 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:19.008545    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:19.293584 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:19.293520    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7xqb" event={"ID":"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad","Type":"ContainerStarted","Data":"f18736326ddc8f02a5e0530384d153427509ce4d2f2c48ab3d72c024541bf3ba"}
Jul 14 19:42:19.293584 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:19.293571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7xqb" event={"ID":"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad","Type":"ContainerStarted","Data":"7bc6de2caa9aafdfe13a8b02fb34507e475051806c0b9f18473eaa2d1935694e"}
Jul 14 19:42:19.866658 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:19.866624    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:20.088247 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.088212    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:20.122750 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.122717    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"]
Jul 14 19:42:20.127660 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.127634    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.132450 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.132428    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8j7f4\""
Jul 14 19:42:20.132450 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.132450    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 19:42:20.132644 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.132598    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 14 19:42:20.132644 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.132622    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 19:42:20.132644 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.132628    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 19:42:20.132839 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.132787    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 14 19:42:20.145204 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.145183    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"]
Jul 14 19:42:20.157289 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.157240    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z2vcr"]
Jul 14 19:42:20.160483 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.160464    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.164956 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.164936    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 19:42:20.165573 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.165554    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 19:42:20.165685 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.165618    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mtsrq\""
Jul 14 19:42:20.166112 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.166068    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 19:42:20.213812 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.213784    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:20.266016 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.265984    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/993bed2e-f043-4ce4-963c-4bcac35e98ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.266184 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266031    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.266184 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-wtmp\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.266184 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266102    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-tls\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.266184 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266129    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aa25975-2af8-464c-8008-ecd0292204a8-metrics-client-ca\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.266388 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrprn\" (UniqueName: \"kubernetes.io/projected/7aa25975-2af8-464c-8008-ecd0292204a8-kube-api-access-jrprn\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.266388 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266266    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxzhf\" (UniqueName: \"kubernetes.io/projected/993bed2e-f043-4ce4-963c-4bcac35e98ad-kube-api-access-fxzhf\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.266388 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-textfile\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.266388 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266345    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aa25975-2af8-464c-8008-ecd0292204a8-sys\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.266388 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266370    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.266630 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266420    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/993bed2e-f043-4ce4-963c-4bcac35e98ad-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.266630 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266444    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/993bed2e-f043-4ce4-963c-4bcac35e98ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.266630 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.266468    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7aa25975-2af8-464c-8008-ecd0292204a8-root\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.367319 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367293    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aa25975-2af8-464c-8008-ecd0292204a8-sys\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.367508 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.367508 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367367    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/993bed2e-f043-4ce4-963c-4bcac35e98ad-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.367508 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367392    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/993bed2e-f043-4ce4-963c-4bcac35e98ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.367508 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367411    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aa25975-2af8-464c-8008-ecd0292204a8-sys\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.367508 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7aa25975-2af8-464c-8008-ecd0292204a8-root\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.367508 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367477    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/993bed2e-f043-4ce4-963c-4bcac35e98ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.367845 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367511    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.367845 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367543    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-wtmp\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.367845 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367572    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-tls\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.367845 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aa25975-2af8-464c-8008-ecd0292204a8-metrics-client-ca\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.367845 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367638    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrprn\" (UniqueName: \"kubernetes.io/projected/7aa25975-2af8-464c-8008-ecd0292204a8-kube-api-access-jrprn\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.367845 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxzhf\" (UniqueName: \"kubernetes.io/projected/993bed2e-f043-4ce4-963c-4bcac35e98ad-kube-api-access-fxzhf\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.367845 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.367731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-textfile\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.368172 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.368052    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-textfile\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.368172 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.368155    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.368267 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.368215    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/993bed2e-f043-4ce4-963c-4bcac35e98ad-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.368316 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.368305    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-wtmp\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.368372 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.368321    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aa25975-2af8-464c-8008-ecd0292204a8-metrics-client-ca\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.368426 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.368376    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7aa25975-2af8-464c-8008-ecd0292204a8-root\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.368426 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:42:20.368392    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 14 19:42:20.368553 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:42:20.368457    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-tls podName:7aa25975-2af8-464c-8008-ecd0292204a8 nodeName:}" failed. No retries permitted until 2026-07-14 19:42:20.868437782 +0000 UTC m=+265.925957315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-tls") pod "node-exporter-z2vcr" (UID: "7aa25975-2af8-464c-8008-ecd0292204a8") : secret "node-exporter-tls" not found
Jul 14 19:42:20.370156 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.370133    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.370789 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.370756    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/993bed2e-f043-4ce4-963c-4bcac35e98ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.370926 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.370903    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/993bed2e-f043-4ce4-963c-4bcac35e98ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.408841 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.408776    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:20.421711 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.421664    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrprn\" (UniqueName: \"kubernetes.io/projected/7aa25975-2af8-464c-8008-ecd0292204a8-kube-api-access-jrprn\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.421899 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.421873    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxzhf\" (UniqueName: \"kubernetes.io/projected/993bed2e-f043-4ce4-963c-4bcac35e98ad-kube-api-access-fxzhf\") pod \"openshift-state-metrics-84bd68b896-shzps\" (UID: \"993bed2e-f043-4ce4-963c-4bcac35e98ad\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.438549 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.438527    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"
Jul 14 19:42:20.558909 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.558878    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:20.580192 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.580156    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-shzps"]
Jul 14 19:42:20.872310 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.872272    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-tls\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:20.874657 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:20.874636    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7aa25975-2af8-464c-8008-ecd0292204a8-node-exporter-tls\") pod \"node-exporter-z2vcr\" (UID: \"7aa25975-2af8-464c-8008-ecd0292204a8\") " pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:21.071303 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:21.071271    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2vcr"
Jul 14 19:42:21.614381 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:42:21.614350    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod993bed2e_f043_4ce4_963c_4bcac35e98ad.slice/crio-00ad02b36b43b86de68997d56b36188c1fb6c3c8d270f4d080d28dafaa7d8cd2 WatchSource:0}: Error finding container 00ad02b36b43b86de68997d56b36188c1fb6c3c8d270f4d080d28dafaa7d8cd2: Status 404 returned error can't find the container with id 00ad02b36b43b86de68997d56b36188c1fb6c3c8d270f4d080d28dafaa7d8cd2
Jul 14 19:42:21.620891 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:42:21.620866    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa25975_2af8_464c_8008_ecd0292204a8.slice/crio-749ddc2789d77e6fa15c10bc5b7792e1a22a01943ffad2410c3183abd07dce13 WatchSource:0}: Error finding container 749ddc2789d77e6fa15c10bc5b7792e1a22a01943ffad2410c3183abd07dce13: Status 404 returned error can't find the container with id 749ddc2789d77e6fa15c10bc5b7792e1a22a01943ffad2410c3183abd07dce13
Jul 14 19:42:22.305182 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:22.305142    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w7xqb" event={"ID":"fcd3593b-6bd6-42c3-bb47-ddefa4f472ad","Type":"ContainerStarted","Data":"38413a2f0f0f6b7037ce59c9e0baf578ce20356b6deda12b876d0b6796cdbce0"}
Jul 14 19:42:22.306632 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:22.306599    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2vcr" event={"ID":"7aa25975-2af8-464c-8008-ecd0292204a8","Type":"ContainerStarted","Data":"749ddc2789d77e6fa15c10bc5b7792e1a22a01943ffad2410c3183abd07dce13"}
Jul 14 19:42:22.308523 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:22.308496    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps" event={"ID":"993bed2e-f043-4ce4-963c-4bcac35e98ad","Type":"ContainerStarted","Data":"9382f03ea89c1e443339a288e0d1561e8191338d672ad3a2823b3bfe9ec89712"}
Jul 14 19:42:22.308652 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:22.308552    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps" event={"ID":"993bed2e-f043-4ce4-963c-4bcac35e98ad","Type":"ContainerStarted","Data":"1d7dcdaee95ef69c5a87d66e01ddcd263195dd3481946556c208de157624114a"}
Jul 14 19:42:22.308652 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:22.308579    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps" event={"ID":"993bed2e-f043-4ce4-963c-4bcac35e98ad","Type":"ContainerStarted","Data":"00ad02b36b43b86de68997d56b36188c1fb6c3c8d270f4d080d28dafaa7d8cd2"}
Jul 14 19:42:22.325149 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:22.325050    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w7xqb" podStartSLOduration=33.518075585 podStartE2EDuration="40.325032278s" totalImagesPullingTime="6.806956693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:41:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:22.323974207 +0000 UTC m=+267.381493786" watchObservedRunningTime="2026-07-14 19:42:22.325032278 +0000 UTC m=+267.382551819"
Jul 14 19:42:22.415258 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:22.415193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:22.515098 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:22.515064    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:23.165139 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:23.165103    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:23.268503 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:23.268478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:23.313259 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:23.313227    2569 generic.go:356] "Generic (PLEG): container finished" podID="7aa25975-2af8-464c-8008-ecd0292204a8" containerID="97d7e664a65250afcf567f517050e2a71432811115ef7743028b601464ca5abf" exitCode=0
Jul 14 19:42:23.313379 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:23.313312    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2vcr" event={"ID":"7aa25975-2af8-464c-8008-ecd0292204a8","Type":"ContainerDied","Data":"97d7e664a65250afcf567f517050e2a71432811115ef7743028b601464ca5abf"}
Jul 14 19:42:23.315312 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:23.315289    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps" event={"ID":"993bed2e-f043-4ce4-963c-4bcac35e98ad","Type":"ContainerStarted","Data":"61a82ccc2b719d7818c53bff2aa2010934c7980ac2dab6826ff3012634004d77"}
Jul 14 19:42:23.361292 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:23.360427    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-shzps" podStartSLOduration=2.328463781 podStartE2EDuration="3.360409307s" totalImagesPullingTime="1.031945526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:23.359565064 +0000 UTC m=+268.417084605" watchObservedRunningTime="2026-07-14 19:42:23.360409307 +0000 UTC m=+268.417928847"
Jul 14 19:42:23.422277 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:23.422253    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:23.529203 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:23.529166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:24.019677 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:24.019641    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:24.320296 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:24.320214    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2vcr" event={"ID":"7aa25975-2af8-464c-8008-ecd0292204a8","Type":"ContainerStarted","Data":"c709d08c545c52a8b8cf22c8568e15e79781e774ad65c453b6c5238898218b62"}
Jul 14 19:42:24.320296 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:24.320275    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2vcr" event={"ID":"7aa25975-2af8-464c-8008-ecd0292204a8","Type":"ContainerStarted","Data":"02ae3557c991cfffd70774c68663e40c810a0c6ef709e23bf98babda8fbc9eb8"}
Jul 14 19:42:24.346098 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:24.346050    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z2vcr" podStartSLOduration=3.144280506 podStartE2EDuration="4.34603671s" totalImagesPullingTime="1.137695192s" totalInitContainerRuntime="64.061012ms" isStatefulPod=true podCreationTimestamp="2026-07-14 19:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:24.344797878 +0000 UTC m=+269.402317420" watchObservedRunningTime="2026-07-14 19:42:24.34603671 +0000 UTC m=+269.403556246"
Jul 14 19:42:24.916550 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:24.916515    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:24.956076 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:24.956048    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"]
Jul 14 19:42:24.959149 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:24.959130    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"
Jul 14 19:42:24.961912 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:24.961893    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-cx9z4\""
Jul 14 19:42:24.962137 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:24.962123    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 14 19:42:24.977720 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:24.977677    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"]
Jul 14 19:42:25.101708 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:25.101675    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:25.105755 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:25.105736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bhpq\" (UniqueName: \"kubernetes.io/projected/4b848658-c3df-44bb-a8d4-76fc9d4a3b26-kube-api-access-9bhpq\") pod \"monitoring-plugin-5f68df7f58-bnm5q\" (UID: \"4b848658-c3df-44bb-a8d4-76fc9d4a3b26\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"
Jul 14 19:42:25.105817 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:25.105768    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b848658-c3df-44bb-a8d4-76fc9d4a3b26-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bnm5q\" (UID: \"4b848658-c3df-44bb-a8d4-76fc9d4a3b26\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"
Jul 14 19:42:25.202208 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:25.202134    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:25.206285 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:25.206266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bhpq\" (UniqueName: \"kubernetes.io/projected/4b848658-c3df-44bb-a8d4-76fc9d4a3b26-kube-api-access-9bhpq\") pod \"monitoring-plugin-5f68df7f58-bnm5q\" (UID: \"4b848658-c3df-44bb-a8d4-76fc9d4a3b26\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"
Jul 14 19:42:25.206350 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:25.206297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b848658-c3df-44bb-a8d4-76fc9d4a3b26-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bnm5q\" (UID: \"4b848658-c3df-44bb-a8d4-76fc9d4a3b26\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"
Jul 14 19:42:25.208571 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:25.208550    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4b848658-c3df-44bb-a8d4-76fc9d4a3b26-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bnm5q\" (UID: \"4b848658-c3df-44bb-a8d4-76fc9d4a3b26\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"
Jul 14 19:42:25.214714 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:25.214682    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bhpq\" (UniqueName: \"kubernetes.io/projected/4b848658-c3df-44bb-a8d4-76fc9d4a3b26-kube-api-access-9bhpq\") pod \"monitoring-plugin-5f68df7f58-bnm5q\" (UID: \"4b848658-c3df-44bb-a8d4-76fc9d4a3b26\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"
Jul 14 19:42:25.267636 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:25.267616    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"
Jul 14 19:42:25.393876 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:25.393855    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"]
Jul 14 19:42:25.395469 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:42:25.395445    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b848658_c3df_44bb_a8d4_76fc9d4a3b26.slice/crio-df85fd598331c4582da7a1fb3e8142d7cf1c2cae84d7fb92ea6d45e395bacab2 WatchSource:0}: Error finding container df85fd598331c4582da7a1fb3e8142d7cf1c2cae84d7fb92ea6d45e395bacab2: Status 404 returned error can't find the container with id df85fd598331c4582da7a1fb3e8142d7cf1c2cae84d7fb92ea6d45e395bacab2
Jul 14 19:42:26.328759 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.328713    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q" event={"ID":"4b848658-c3df-44bb-a8d4-76fc9d4a3b26","Type":"ContainerStarted","Data":"df85fd598331c4582da7a1fb3e8142d7cf1c2cae84d7fb92ea6d45e395bacab2"}
Jul 14 19:42:26.477297 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.477252    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:26.483594 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.483563    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 19:42:26.488718 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.488682    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.491348 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.491328    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 19:42:26.491828 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.491804    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 19:42:26.491987 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.491899    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 19:42:26.491987 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.491898    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 19:42:26.492522 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.492505    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 19:42:26.492824 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.492660    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 19:42:26.492824 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.492683    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 19:42:26.492824 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.492713    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9k1qaca8fu355\""
Jul 14 19:42:26.492824 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.492728    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 19:42:26.492824 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.492733    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 19:42:26.493102 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.493086    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 19:42:26.493289 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.493274    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 19:42:26.493375 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.493308    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 19:42:26.493928 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.493709    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bqxtw\""
Jul 14 19:42:26.493928 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.493717    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 19:42:26.493928 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.493783    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 19:42:26.495532 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.495504    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 19:42:26.517770 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.517740    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 19:42:26.599520 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.599450    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:26.616567 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616545    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616661 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616661 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616605    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616661 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616780 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616678    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616780 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616780 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616780 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616761    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616894 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616894 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-config\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616894 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616830    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616894 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616848    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n67x\" (UniqueName: \"kubernetes.io/projected/bd679875-aa45-4698-9051-6d083fcaf0ed-kube-api-access-7n67x\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616894 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.616894 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616886    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd679875-aa45-4698-9051-6d083fcaf0ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.617072 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616904    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd679875-aa45-4698-9051-6d083fcaf0ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.617072 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616930    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.617072 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.616969    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.617072 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.617002    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.617072 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.617026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.617072 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.617040    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.717621 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717592    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.717621 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.717805 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717649    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.717805 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.717805 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717716    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.717930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717826    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.717930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717865    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.717930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717898    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.717930 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717922    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718103 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717950    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-config\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718103 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.717979    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718103 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718007    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n67x\" (UniqueName: \"kubernetes.io/projected/bd679875-aa45-4698-9051-6d083fcaf0ed-kube-api-access-7n67x\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718103 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718034    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718103 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718064    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd679875-aa45-4698-9051-6d083fcaf0ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718103 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718095    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd679875-aa45-4698-9051-6d083fcaf0ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718410 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718119    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718410 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718410 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718186    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718597 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718571    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718668 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718814    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.718918 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.718854    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.719813 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.719785    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.720575 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.720549    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.720889 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.720864    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.721018 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.720996    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.721078 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.721028    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.721831 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.721540    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.721831 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.721791    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.721980 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.721832    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd679875-aa45-4698-9051-6d083fcaf0ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.721980 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.721960    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.722478 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.722444    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.722740 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.722716    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.722846 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.722724    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.722846 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.722752    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.723534 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.723509    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.723979 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.723958    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd679875-aa45-4698-9051-6d083fcaf0ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.724030 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.724008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bd679875-aa45-4698-9051-6d083fcaf0ed-config\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.724556 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.724533    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd679875-aa45-4698-9051-6d083fcaf0ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.727756 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.727737    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n67x\" (UniqueName: \"kubernetes.io/projected/bd679875-aa45-4698-9051-6d083fcaf0ed-kube-api-access-7n67x\") pod \"prometheus-k8s-0\" (UID: \"bd679875-aa45-4698-9051-6d083fcaf0ed\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.800310 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.800283    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:26.948190 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:42:26.948160    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd679875_aa45_4698_9051_6d083fcaf0ed.slice/crio-8ad24e2303130ef9414cf332b9648a4eb4589f2cd38a92796929c8ee8c65ca53 WatchSource:0}: Error finding container 8ad24e2303130ef9414cf332b9648a4eb4589f2cd38a92796929c8ee8c65ca53: Status 404 returned error can't find the container with id 8ad24e2303130ef9414cf332b9648a4eb4589f2cd38a92796929c8ee8c65ca53
Jul 14 19:42:26.948438 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:26.948413    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 19:42:27.333996 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:27.333959    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q" event={"ID":"4b848658-c3df-44bb-a8d4-76fc9d4a3b26","Type":"ContainerStarted","Data":"9147862551fe7a404b9a4914ac9acd8659ee492beb80897917e70340ab1695b5"}
Jul 14 19:42:27.334237 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:27.334218    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"
Jul 14 19:42:27.335347 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:27.335316    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd679875-aa45-4698-9051-6d083fcaf0ed","Type":"ContainerStarted","Data":"8ad24e2303130ef9414cf332b9648a4eb4589f2cd38a92796929c8ee8c65ca53"}
Jul 14 19:42:27.339939 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:27.339917    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q"
Jul 14 19:42:27.352987 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:27.352938    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bnm5q" podStartSLOduration=2.115864932 podStartE2EDuration="3.35291516s" totalImagesPullingTime="1.237050228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:27.351306034 +0000 UTC m=+272.408825576" watchObservedRunningTime="2026-07-14 19:42:27.35291516 +0000 UTC m=+272.410434700"
Jul 14 19:42:27.394032 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:27.393999    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:28.340199 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:28.340158    2569 generic.go:356] "Generic (PLEG): container finished" podID="bd679875-aa45-4698-9051-6d083fcaf0ed" containerID="2f22808bc7a02ab3c9b111413cfcc781e8338ce2c05c1bd8973d7c37ed146020" exitCode=0
Jul 14 19:42:28.340590 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:28.340249    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd679875-aa45-4698-9051-6d083fcaf0ed","Type":"ContainerDied","Data":"2f22808bc7a02ab3c9b111413cfcc781e8338ce2c05c1bd8973d7c37ed146020"}
Jul 14 19:42:32.361156 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:32.361125    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd679875-aa45-4698-9051-6d083fcaf0ed","Type":"ContainerStarted","Data":"98ec7d5cd2b7b4ddb06b23c2df2263983652308a32e4fff9362bcc498493e3b0"}
Jul 14 19:42:33.366654 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:33.366609    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd679875-aa45-4698-9051-6d083fcaf0ed","Type":"ContainerStarted","Data":"051602580f8c7ae581f0660d6c103e9706799340edbb84cfbece0d442b29204d"}
Jul 14 19:42:34.705231 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:34.705197    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:37.382646 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:37.382610    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd679875-aa45-4698-9051-6d083fcaf0ed","Type":"ContainerStarted","Data":"8f5ee27c15f2930712e72a65ccdec1536bfa9061121fee504aec906f83194b96"}
Jul 14 19:42:37.383102 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:37.382734    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd679875-aa45-4698-9051-6d083fcaf0ed","Type":"ContainerStarted","Data":"b99128cebee9cf47cead16525e7d647c2e75b86c5a10b081c739844e6d0d64cf"}
Jul 14 19:42:37.383102 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:37.382781    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd679875-aa45-4698-9051-6d083fcaf0ed","Type":"ContainerStarted","Data":"da4128e65f743028f405ed4c0af81fde10d77f27f75e48a7ffe5a1d8179f812f"}
Jul 14 19:42:37.383102 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:37.382824    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bd679875-aa45-4698-9051-6d083fcaf0ed","Type":"ContainerStarted","Data":"1fe32f8eb66511f27dab2f7d43a67a3fa721cb5d243c396739c4b5204a0a3c67"}
Jul 14 19:42:37.418080 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:37.417817    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.58631843 podStartE2EDuration="11.417796824s" totalImagesPullingTime="8.812962509s" totalInitContainerRuntime="18.515885ms" isStatefulPod=false podCreationTimestamp="2026-07-14 19:42:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:37.415982205 +0000 UTC m=+282.473501745" watchObservedRunningTime="2026-07-14 19:42:37.417796824 +0000 UTC m=+282.475316365"
Jul 14 19:42:37.521086 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:37.521057    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:39.505812 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:39.505779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:39.594662 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:39.594629    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:40.356209 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:40.356179    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:40.457184 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:40.457152    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:41.377255 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:41.377217    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" podUID="e402558e-3f9c-4f59-9eb8-2f683da2b704" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 14 19:42:41.801167 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:41.801080    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:42:42.994484 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:42:42.994444    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-smbdz" podUID="4f3189cc-6793-417a-9aa9-9674b1b6f793"
Jul 14 19:42:43.400526 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:43.400499    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smbdz"
Jul 14 19:42:44.266170 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:44.266132    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:44.369039 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:44.369012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:46.764567 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:46.764531    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:42:46.766761 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:46.766741    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f3189cc-6793-417a-9aa9-9674b1b6f793-metrics-tls\") pod \"dns-default-smbdz\" (UID: \"4f3189cc-6793-417a-9aa9-9674b1b6f793\") " pod="openshift-dns/dns-default-smbdz"
Jul 14 19:42:47.004972 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:47.004901    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-774zx\""
Jul 14 19:42:47.012172 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:47.012152    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-smbdz"
Jul 14 19:42:47.142556 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:47.142523    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-smbdz"]
Jul 14 19:42:47.145183 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:42:47.145154    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3189cc_6793_417a_9aa9_9674b1b6f793.slice/crio-70bc3c0c6ea8ac907955a8c13534636ea78d86fcad1f172cbb7c43152587c96e WatchSource:0}: Error finding container 70bc3c0c6ea8ac907955a8c13534636ea78d86fcad1f172cbb7c43152587c96e: Status 404 returned error can't find the container with id 70bc3c0c6ea8ac907955a8c13534636ea78d86fcad1f172cbb7c43152587c96e
Jul 14 19:42:47.415669 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:47.415631    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smbdz" event={"ID":"4f3189cc-6793-417a-9aa9-9674b1b6f793","Type":"ContainerStarted","Data":"70bc3c0c6ea8ac907955a8c13534636ea78d86fcad1f172cbb7c43152587c96e"}
Jul 14 19:42:50.429444 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:50.429406    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smbdz" event={"ID":"4f3189cc-6793-417a-9aa9-9674b1b6f793","Type":"ContainerStarted","Data":"4ab6cc63d805446eb76d7f132a48eccb8b4705374ab7dc29e1ec715e25d659b8"}
Jul 14 19:42:50.429992 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:50.429455    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-smbdz" event={"ID":"4f3189cc-6793-417a-9aa9-9674b1b6f793","Type":"ContainerStarted","Data":"f6b9b17ae156543eb53a1ce1b60429d7524b23a3c540eac0cf310c6f27ed115f"}
Jul 14 19:42:50.429992 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:50.429487    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-smbdz"
Jul 14 19:42:50.450061 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:50.450015    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-smbdz" podStartSLOduration=252.036339292 podStartE2EDuration="4m14.450000534s" totalImagesPullingTime="2.413661242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:50.448885951 +0000 UTC m=+295.506405490" watchObservedRunningTime="2026-07-14 19:42:50.450000534 +0000 UTC m=+295.507520074"
Jul 14 19:42:51.377823 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:51.377778    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" podUID="e402558e-3f9c-4f59-9eb8-2f683da2b704" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 14 19:42:53.782537 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:53.782508    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:53.852434 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:53.852408    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:55.358735 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:55.358683    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:42:55.360099 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:55.360080    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:42:55.366473 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:55.366454    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 19:42:57.124176 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:57.124141    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-bnm5q_4b848658-c3df-44bb-a8d4-76fc9d4a3b26/monitoring-plugin/0.log"
Jul 14 19:42:58.456379 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:58.456290    2569 generic.go:356] "Generic (PLEG): container finished" podID="b82c48ac-3975-4b26-b8c8-2baa1df22c86" containerID="f3fe94052ae6758cc3d5ef772ebb748944f595fe2409492d2a608dd8d1f0d156" exitCode=1
Jul 14 19:42:58.456379 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:58.456364    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" event={"ID":"b82c48ac-3975-4b26-b8c8-2baa1df22c86","Type":"ContainerDied","Data":"f3fe94052ae6758cc3d5ef772ebb748944f595fe2409492d2a608dd8d1f0d156"}
Jul 14 19:42:58.456889 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:58.456424    2569 scope.go:117] "RemoveContainer" containerID="1816d42393a048c0eec123d4a283bfcbbfb795df8ef8bdc2dc00239861282949"
Jul 14 19:42:58.456889 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:58.456752    2569 scope.go:117] "RemoveContainer" containerID="f3fe94052ae6758cc3d5ef772ebb748944f595fe2409492d2a608dd8d1f0d156"
Jul 14 19:42:58.456999 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:42:58.456955    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-75df7fb545-ts9xc_open-cluster-management-agent-addon(b82c48ac-3975-4b26-b8c8-2baa1df22c86)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" podUID="b82c48ac-3975-4b26-b8c8-2baa1df22c86"
Jul 14 19:42:58.514086 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:58.514061    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2vcr_7aa25975-2af8-464c-8008-ecd0292204a8/init-textfile/0.log"
Jul 14 19:42:58.715813 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:58.715741    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2vcr_7aa25975-2af8-464c-8008-ecd0292204a8/node-exporter/0.log"
Jul 14 19:42:58.804199 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:58.804174    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:42:58.914094 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:58.914069    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2vcr_7aa25975-2af8-464c-8008-ecd0292204a8/kube-rbac-proxy/0.log"
Jul 14 19:42:59.055285 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:59.055212    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:42:59.125181 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:59.125148    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-shzps_993bed2e-f043-4ce4-963c-4bcac35e98ad/kube-rbac-proxy-main/0.log"
Jul 14 19:42:59.317419 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:59.317357    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-shzps_993bed2e-f043-4ce4-963c-4bcac35e98ad/kube-rbac-proxy-self/0.log"
Jul 14 19:42:59.460823 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:59.460801    2569 scope.go:117] "RemoveContainer" containerID="f3fe94052ae6758cc3d5ef772ebb748944f595fe2409492d2a608dd8d1f0d156"
Jul 14 19:42:59.461156 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:42:59.460967    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-75df7fb545-ts9xc_open-cluster-management-agent-addon(b82c48ac-3975-4b26-b8c8-2baa1df22c86)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" podUID="b82c48ac-3975-4b26-b8c8-2baa1df22c86"
Jul 14 19:42:59.514177 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:59.514154    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-shzps_993bed2e-f043-4ce4-963c-4bcac35e98ad/openshift-state-metrics/0.log"
Jul 14 19:42:59.715135 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:59.715099    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/init-config-reloader/0.log"
Jul 14 19:42:59.915591 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:42:59.915559    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/prometheus/0.log"
Jul 14 19:43:00.074457 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:00.074368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:00.114135 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:00.114111    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/config-reloader/0.log"
Jul 14 19:43:00.314948 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:00.314921    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/thanos-sidecar/0.log"
Jul 14 19:43:00.435948 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:00.435923    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-smbdz"
Jul 14 19:43:00.514063 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:00.514018    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/kube-rbac-proxy-web/0.log"
Jul 14 19:43:00.714222 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:00.714147    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/kube-rbac-proxy/0.log"
Jul 14 19:43:00.913855 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:00.913821    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/kube-rbac-proxy-thanos/0.log"
Jul 14 19:43:01.033181 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:01.033112    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:01.108553 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:01.108524    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:01.274665 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:01.274639    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:01.348603 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:01.348543    2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:43:01.348877 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:01.348865    2569 scope.go:117] "RemoveContainer" containerID="f3fe94052ae6758cc3d5ef772ebb748944f595fe2409492d2a608dd8d1f0d156"
Jul 14 19:43:01.349030 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:43:01.349013    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-75df7fb545-ts9xc_open-cluster-management-agent-addon(b82c48ac-3975-4b26-b8c8-2baa1df22c86)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" podUID="b82c48ac-3975-4b26-b8c8-2baa1df22c86"
Jul 14 19:43:01.378271 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:01.378239    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" podUID="e402558e-3f9c-4f59-9eb8-2f683da2b704" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 14 19:43:01.378367 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:01.378310    2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7"
Jul 14 19:43:01.378812 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:01.378780    2569 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"6b7bc4f5e1eac2a64810f3e8c7732f2a1ae81b86dcc723be0cc7635b5e3e7aba"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 14 19:43:01.378893 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:01.378838    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" podUID="e402558e-3f9c-4f59-9eb8-2f683da2b704" containerName="service-proxy" containerID="cri-o://6b7bc4f5e1eac2a64810f3e8c7732f2a1ae81b86dcc723be0cc7635b5e3e7aba" gracePeriod=30
Jul 14 19:43:01.379438 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:01.379294    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:02.471935 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:02.471904    2569 generic.go:356] "Generic (PLEG): container finished" podID="e402558e-3f9c-4f59-9eb8-2f683da2b704" containerID="6b7bc4f5e1eac2a64810f3e8c7732f2a1ae81b86dcc723be0cc7635b5e3e7aba" exitCode=2
Jul 14 19:43:02.472288 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:02.471945    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" event={"ID":"e402558e-3f9c-4f59-9eb8-2f683da2b704","Type":"ContainerDied","Data":"6b7bc4f5e1eac2a64810f3e8c7732f2a1ae81b86dcc723be0cc7635b5e3e7aba"}
Jul 14 19:43:02.472288 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:02.471977    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5565f9f5c7-29pf7" event={"ID":"e402558e-3f9c-4f59-9eb8-2f683da2b704","Type":"ContainerStarted","Data":"2276a284fa3a97f64df18393b774cf0d95e208ed692314de942e89e0beb9fc4d"}
Jul 14 19:43:04.176223 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:04.176187    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:04.276649 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:04.276617    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:04.376736 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:04.376691    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:05.114018 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:05.113990    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smbdz_4f3189cc-6793-417a-9aa9-9674b1b6f793/dns/0.log"
Jul 14 19:43:05.315062 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:05.315035    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smbdz_4f3189cc-6793-417a-9aa9-9674b1b6f793/kube-rbac-proxy/0.log"
Jul 14 19:43:05.714830 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:05.714802    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wchmn_c2f1d400-6300-4f87-9afd-39f401c4fba9/dns-node-resolver/0.log"
Jul 14 19:43:06.714520 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:06.714494    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-stxdp_71c434f7-a30f-42b1-b347-bc7d5e630991/node-ca/0.log"
Jul 14 19:43:07.078673 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:07.078597    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:07.197680 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:07.197645    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:07.294814 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:07.294780    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:07.714133 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:07.714106    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ww5zf_bdf0ad82-65fb-40ac-9729-fcade69a2cde/serve-healthcheck-canary/0.log"
Jul 14 19:43:08.158475 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:08.158428    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:08.249235 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:08.249206    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:08.345441 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:08.345397    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:11.765396 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:11.765361    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:11.900134 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:11.900105    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:13.439622 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:13.439594    2569 scope.go:117] "RemoveContainer" containerID="f3fe94052ae6758cc3d5ef772ebb748944f595fe2409492d2a608dd8d1f0d156"
Jul 14 19:43:13.513690 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:13.513666    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" event={"ID":"b82c48ac-3975-4b26-b8c8-2baa1df22c86","Type":"ContainerStarted","Data":"8717da17a0ac189ed258035824c9fd85c711a5de7061a9837eb5ab360ee78685"}
Jul 14 19:43:13.513991 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:13.513971    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:43:13.515281 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:13.515084    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc" podUID="b82c48ac-3975-4b26-b8c8-2baa1df22c86" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/readyz\": dial tcp 10.132.0.8:8000: connect: connection refused"
Jul 14 19:43:14.517978 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:14.517950    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75df7fb545-ts9xc"
Jul 14 19:43:14.814077 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:14.814005    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:14.913005 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:14.912977    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:16.200644 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:16.200615    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:16.295443 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:16.295416    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:16.371648 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:16.371622    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:22.100532 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:22.100499    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:22.483506 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:22.483474    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:24.625458 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:24.625430    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:26.801290 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:26.801260    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:43:26.819840 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:26.819815    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:43:27.576563 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:27.576531    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 19:43:33.519649 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:33.519610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:35.558050 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:35.558015    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:35.624978 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:35.624936    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:37.474574 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:37.474543    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:37.542047 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:37.542014    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:39.515816 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:39.515779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:41.713293 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:41.713263    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:51.167772 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:51.167670    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:51.267623 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:51.267597    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:52.478743 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:52.478689    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:52.578423 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:52.578383    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:54.757375 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:54.757338    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:43:54.858094 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:43:54.858060    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:01.700301 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:01.700274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:01.777254 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:01.777225    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:02.580129 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:02.580097    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:02.830725 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:02.830598    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:02.927059 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:02.927027    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:03.424103 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:03.424071    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:03.494983 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:03.494953    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:04.233838 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:04.233803    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:04.310929 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:04.310904    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:07.512689 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:07.512651    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:07.610748 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:07.610715    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:13.921589 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:13.921555    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:14.026714 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:14.026658    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:14.131945 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:14.131906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:22.794027 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:22.793988    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:22.875020 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:22.874989    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:49.783583 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:49.783546    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:49.976343 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:49.976309    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:44:56.386439 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:44:56.386403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:18.124777 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:18.124685    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:18.240035 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:18.239997    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:23.001409 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:23.001374    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:23.109419 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:23.109380    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:26.309189 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:26.309138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:26.475049 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:26.475019    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:27.626916 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:27.626886    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:27.778923 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:27.778892    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:29.301102 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:29.301071    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:29.403458 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:29.403431    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:34.924690 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:34.924645    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:35.036731 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:35.036680    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:35.207120 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:35.207046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:35.825868 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:35.825835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:35.954099 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:35.954071    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:37.700936 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:37.700906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:37.813445 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:37.813417    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:42.746670 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:42.746637    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:42.841956 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:42.841927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:44.270690 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:44.270657    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:59.750540 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:59.750509    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:45:59.863497 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:45:59.863464    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:00.352644 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:00.352614    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:01.006838 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.006809    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:01.145749 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.145721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:01.239769 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.239743    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"]
Jul 14 19:46:01.242266 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.242251    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.245890 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.245866    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wl8d8\""
Jul 14 19:46:01.246135 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.246120    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 19:46:01.246261 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.246234    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 19:46:01.246935 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.246914    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 19:46:01.251017 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.250995    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 19:46:01.261359 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.261310    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05f373da-aa99-4a1b-ab07-069aa712f496-tmp\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.261359 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.261338    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05f373da-aa99-4a1b-ab07-069aa712f496-manifests\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.261488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.261374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05f373da-aa99-4a1b-ab07-069aa712f496-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.261488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.261426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05f373da-aa99-4a1b-ab07-069aa712f496-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.261488 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.261452    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f27qv\" (UniqueName: \"kubernetes.io/projected/05f373da-aa99-4a1b-ab07-069aa712f496-kube-api-access-f27qv\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.282953 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.282933    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"]
Jul 14 19:46:01.362669 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.362641    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05f373da-aa99-4a1b-ab07-069aa712f496-tmp\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.362790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.362674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05f373da-aa99-4a1b-ab07-069aa712f496-manifests\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.362790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.362746    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05f373da-aa99-4a1b-ab07-069aa712f496-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.362790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.362775    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05f373da-aa99-4a1b-ab07-069aa712f496-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.362909 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.362800    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f27qv\" (UniqueName: \"kubernetes.io/projected/05f373da-aa99-4a1b-ab07-069aa712f496-kube-api-access-f27qv\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.363140 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.363115    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/05f373da-aa99-4a1b-ab07-069aa712f496-manifests\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.364839 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.364812    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05f373da-aa99-4a1b-ab07-069aa712f496-tmp\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.365147 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.365126    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/05f373da-aa99-4a1b-ab07-069aa712f496-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.365147 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.365136    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/05f373da-aa99-4a1b-ab07-069aa712f496-webhook-cert\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.379574 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.379555    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f27qv\" (UniqueName: \"kubernetes.io/projected/05f373da-aa99-4a1b-ab07-069aa712f496-kube-api-access-f27qv\") pod \"opendatahub-operator-controller-manager-fdfc6fcb8-plk5s\" (UID: \"05f373da-aa99-4a1b-ab07-069aa712f496\") " pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.458235 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.458209    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:01.552099 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.552022    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:01.591446 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.591415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:01.696335 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.696305    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:01.701211 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.701183    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"]
Jul 14 19:46:01.704240 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:46:01.704217    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f373da_aa99_4a1b_ab07_069aa712f496.slice/crio-9b190cb87920b6973f700c202064c05849fe1a1e6591fcf4b088758207708afd WatchSource:0}: Error finding container 9b190cb87920b6973f700c202064c05849fe1a1e6591fcf4b088758207708afd: Status 404 returned error can't find the container with id 9b190cb87920b6973f700c202064c05849fe1a1e6591fcf4b088758207708afd
Jul 14 19:46:01.705924 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.705907    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:46:01.808125 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.808052    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:01.913755 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:01.913726    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:02.020806 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:02.020780    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:02.085508 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:02.085430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s" event={"ID":"05f373da-aa99-4a1b-ab07-069aa712f496","Type":"ContainerStarted","Data":"9b190cb87920b6973f700c202064c05849fe1a1e6591fcf4b088758207708afd"}
Jul 14 19:46:05.099331 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:05.099297    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s" event={"ID":"05f373da-aa99-4a1b-ab07-069aa712f496","Type":"ContainerStarted","Data":"3a9b741f9d4245e5c189cb761741ab7bb6cdc6dcafb4151dc86c425807ebf388"}
Jul 14 19:46:06.103820 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:06.103781    2569 generic.go:356] "Generic (PLEG): container finished" podID="05f373da-aa99-4a1b-ab07-069aa712f496" containerID="3a9b741f9d4245e5c189cb761741ab7bb6cdc6dcafb4151dc86c425807ebf388" exitCode=0
Jul 14 19:46:06.104173 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:06.103865    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s" event={"ID":"05f373da-aa99-4a1b-ab07-069aa712f496","Type":"ContainerDied","Data":"3a9b741f9d4245e5c189cb761741ab7bb6cdc6dcafb4151dc86c425807ebf388"}
Jul 14 19:46:07.109305 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:07.109270    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s" event={"ID":"05f373da-aa99-4a1b-ab07-069aa712f496","Type":"ContainerStarted","Data":"f0e8c8d891d3201fa789fad12da236da7001fe11eb5f7162f41e8d714d37b0f0"}
Jul 14 19:46:07.109718 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:07.109376    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:07.143175 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:07.143121    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s" podStartSLOduration=1.600528069 podStartE2EDuration="6.143106496s" totalImagesPullingTime="3.52292955s" totalInitContainerRuntime="1.019648877s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:46:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:46:07.140367413 +0000 UTC m=+492.197886971" watchObservedRunningTime="2026-07-14 19:46:07.143106496 +0000 UTC m=+492.200626036"
Jul 14 19:46:10.555957 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:10.555923    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:10.656738 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:10.656706    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:18.116121 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:18.116091    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-fdfc6fcb8-plk5s"
Jul 14 19:46:21.583904 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:21.583871    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:21.881087 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:21.881060    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:22.287365 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:22.287288    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:22.736441 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:22.736373    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:23.025234 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:23.025148    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:23.304010 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:23.303936    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:23.510970 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:23.510942    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:24.284029 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:24.283994    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:24.602382 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:24.602295    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:27.051685 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:27.051622    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:27.191093 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:27.191043    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:27.704439 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:27.704408    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:30.664469 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.664441    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"]
Jul 14 19:46:30.668775 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.668759    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.671740 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.671712    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 14 19:46:30.671842 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.671823    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 14 19:46:30.672151 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.672134    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 19:46:30.673001 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.672964    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 19:46:30.673001 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.672975    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9kvsg\""
Jul 14 19:46:30.673170 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.673038    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 14 19:46:30.692205 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.692187    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"]
Jul 14 19:46:30.783027 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.782992    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-manager-config\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.783204 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.783037    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzgrt\" (UniqueName: \"kubernetes.io/projected/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-kube-api-access-lzgrt\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.783204 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.783067    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-metrics-cert\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.783204 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.783128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-cert\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.884492 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.884461    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-metrics-cert\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.884632 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.884500    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-cert\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.884632 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.884538    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-manager-config\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.884632 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.884577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzgrt\" (UniqueName: \"kubernetes.io/projected/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-kube-api-access-lzgrt\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.885221 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.885198    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-manager-config\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.886884 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.886866    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-metrics-cert\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.887043 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.887025    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-cert\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.910175 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.910155    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzgrt\" (UniqueName: \"kubernetes.io/projected/ee5de2ba-8421-4f9a-81eb-a4f598fc5164-kube-api-access-lzgrt\") pod \"lws-controller-manager-7f49b85c7f-8d5wd\" (UID: \"ee5de2ba-8421-4f9a-81eb-a4f598fc5164\") " pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:30.965334 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.965277    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:30.978281 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:30.978258    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:31.151105 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:46:31.151072    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5de2ba_8421_4f9a_81eb_a4f598fc5164.slice/crio-e7a098c7de511e68614e57644d3813a476822025e8510dc7795d4ba3efa681ac WatchSource:0}: Error finding container e7a098c7de511e68614e57644d3813a476822025e8510dc7795d4ba3efa681ac: Status 404 returned error can't find the container with id e7a098c7de511e68614e57644d3813a476822025e8510dc7795d4ba3efa681ac
Jul 14 19:46:31.154736 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.154715    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"]
Jul 14 19:46:31.197737 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.197683    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd" event={"ID":"ee5de2ba-8421-4f9a-81eb-a4f598fc5164","Type":"ContainerStarted","Data":"e7a098c7de511e68614e57644d3813a476822025e8510dc7795d4ba3efa681ac"}
Jul 14 19:46:31.301911 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.301849    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:31.843537 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.843513    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"]
Jul 14 19:46:31.847427 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.847411    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:31.858021 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.858002    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 14 19:46:31.858918 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.858897    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 14 19:46:31.859162 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.859151    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 14 19:46:31.859206 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.859179    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 19:46:31.863080 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.863065    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 14 19:46:31.863614 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.863601    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n627z\""
Jul 14 19:46:31.864493 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.864480    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 19:46:31.902481 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.902454    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"]
Jul 14 19:46:31.992229 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.992198    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:31.992229 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.992236    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:31.992438 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.992317    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c4d12f92-5a19-45e3-9ef6-c6fe48920596-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:31.992438 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.992358    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4d12f92-5a19-45e3-9ef6-c6fe48920596-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:31.992438 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.992400    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvjs5\" (UniqueName: \"kubernetes.io/projected/c4d12f92-5a19-45e3-9ef6-c6fe48920596-kube-api-access-wvjs5\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:31.992555 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.992457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:31.992555 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:31.992494    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.093405 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.093369    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.093619 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.093425    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.093619 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.093595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c4d12f92-5a19-45e3-9ef6-c6fe48920596-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.093858 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.093637    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4d12f92-5a19-45e3-9ef6-c6fe48920596-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.093858 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.093679    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvjs5\" (UniqueName: \"kubernetes.io/projected/c4d12f92-5a19-45e3-9ef6-c6fe48920596-kube-api-access-wvjs5\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.093858 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.093753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.093858 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.093798    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.094523 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.094468    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.096432 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.096386    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.096432 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.096399    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4d12f92-5a19-45e3-9ef6-c6fe48920596-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.097050 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.097009    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.097220 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.097200    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c4d12f92-5a19-45e3-9ef6-c6fe48920596-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.120628 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.120601    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4d12f92-5a19-45e3-9ef6-c6fe48920596-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.131222 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.131193    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvjs5\" (UniqueName: \"kubernetes.io/projected/c4d12f92-5a19-45e3-9ef6-c6fe48920596-kube-api-access-wvjs5\") pod \"istiod-openshift-gateway-94bb8fbfd-rj44h\" (UID: \"c4d12f92-5a19-45e3-9ef6-c6fe48920596\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.156057 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.156023    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:32.336153 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:32.335911    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"]
Jul 14 19:46:32.340612 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:46:32.340579    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d12f92_5a19_45e3_9ef6_c6fe48920596.slice/crio-8c73df9a77d5f206f17b05ddca020552df04d25f615a8425b613a89c8d98d802 WatchSource:0}: Error finding container 8c73df9a77d5f206f17b05ddca020552df04d25f615a8425b613a89c8d98d802: Status 404 returned error can't find the container with id 8c73df9a77d5f206f17b05ddca020552df04d25f615a8425b613a89c8d98d802
Jul 14 19:46:33.208352 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:33.208309    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h" event={"ID":"c4d12f92-5a19-45e3-9ef6-c6fe48920596","Type":"ContainerStarted","Data":"8c73df9a77d5f206f17b05ddca020552df04d25f615a8425b613a89c8d98d802"}
Jul 14 19:46:33.239778 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:33.239744    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:33.651911 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:33.651884    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:33.816130 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:33.816095    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:34.214447 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:34.214411    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd" event={"ID":"ee5de2ba-8421-4f9a-81eb-a4f598fc5164","Type":"ContainerStarted","Data":"1e079f2273756c140f74367bc5e4215300d5a448f1238852c078881e3b77db2d"}
Jul 14 19:46:34.214956 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:34.214550    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:35.216374 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:35.216336    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:35.424684 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:35.424645    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:35.632568 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:35.632518    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 19:46:35.632753 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:35.632609    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 19:46:35.713009 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:35.712978    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:35.910584 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:35.910494    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:36.190723 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:36.190606    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:36.224063 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:36.224034    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h" event={"ID":"c4d12f92-5a19-45e3-9ef6-c6fe48920596","Type":"ContainerStarted","Data":"d88b4c0f690a88424888b85eebf15818d88b6280fadf1df56e9190a34aaafa62"}
Jul 14 19:46:36.224415 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:36.224183    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:36.225833 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:36.225801    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-rj44h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 19:46:36.225947 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:36.225849    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h" podUID="c4d12f92-5a19-45e3-9ef6-c6fe48920596" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 19:46:36.290303 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:36.290263    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd" podStartSLOduration=3.718012519 podStartE2EDuration="6.290249705s" totalImagesPullingTime="2.572237186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:46:34.252056571 +0000 UTC m=+519.309576110" watchObservedRunningTime="2026-07-14 19:46:36.290249705 +0000 UTC m=+521.347769246"
Jul 14 19:46:36.290423 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:36.290341    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h" podStartSLOduration=2.001533031 podStartE2EDuration="5.290336566s" totalImagesPullingTime="3.288803535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:46:36.289869802 +0000 UTC m=+521.347389343" watchObservedRunningTime="2026-07-14 19:46:36.290336566 +0000 UTC m=+521.347856105"
Jul 14 19:46:37.037206 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:37.037175    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:37.228625 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:37.228591    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-rj44h container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 19:46:37.229054 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:37.228638    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h" podUID="c4d12f92-5a19-45e3-9ef6-c6fe48920596" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 19:46:37.339297 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:37.339227    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:37.535130 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:37.535099    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:46:40.229174 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:40.229146    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rj44h"
Jul 14 19:46:45.221415 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:45.221387    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f49b85c7f-8d5wd"
Jul 14 19:46:48.315973 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:46:48.315884    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:47:17.944403 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:47:17.944352    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:47:23.171861 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:47:23.171815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:47:23.266801 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:47:23.266775    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:47:23.389660 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:47:23.389627    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:47:52.145894 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:47:52.145868    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:47:55.364199 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:47:55.364168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:47:55.383868 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:47:55.383845    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:47:55.384036 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:47:55.384012    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:47:55.511737 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:47:55.511675    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:00.873352 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:00.873306    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:02.640139 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:02.640110    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:03.338728 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:03.338674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:03.583066 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:03.582981    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:03.749955 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:03.749927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:06.025755 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:06.025723    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:06.150909 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:06.150878    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:07.969458 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:07.969426    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:08.122920 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:08.122887    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:11.477543 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:11.477506    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:11.578788 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:11.578751    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:13.132117 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:13.132070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:13.288029 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:13.287994    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:17.452584 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:17.452457    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:17.549207 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:17.549170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:20.243058 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:20.243012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:20.342406 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:20.342375    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:23.241310 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.241280    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"]
Jul 14 19:48:23.244352 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.244334    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:23.247207 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.247176    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8tl8d\""
Jul 14 19:48:23.247207 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.247194    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 19:48:23.247403 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.247199    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 19:48:23.262519 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.262495    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"]
Jul 14 19:48:23.363574 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.363545    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc4fd\" (UniqueName: \"kubernetes.io/projected/78af5547-8f6c-4b9e-876f-63f0061e31a2-kube-api-access-cc4fd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sh7g2\" (UID: \"78af5547-8f6c-4b9e-876f-63f0061e31a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:23.363735 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.363587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78af5547-8f6c-4b9e-876f-63f0061e31a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sh7g2\" (UID: \"78af5547-8f6c-4b9e-876f-63f0061e31a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:23.464358 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.464323    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc4fd\" (UniqueName: \"kubernetes.io/projected/78af5547-8f6c-4b9e-876f-63f0061e31a2-kube-api-access-cc4fd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sh7g2\" (UID: \"78af5547-8f6c-4b9e-876f-63f0061e31a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:23.464358 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.464373    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78af5547-8f6c-4b9e-876f-63f0061e31a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sh7g2\" (UID: \"78af5547-8f6c-4b9e-876f-63f0061e31a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:23.464660 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.464645    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78af5547-8f6c-4b9e-876f-63f0061e31a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sh7g2\" (UID: \"78af5547-8f6c-4b9e-876f-63f0061e31a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:23.473390 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.473364    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc4fd\" (UniqueName: \"kubernetes.io/projected/78af5547-8f6c-4b9e-876f-63f0061e31a2-kube-api-access-cc4fd\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sh7g2\" (UID: \"78af5547-8f6c-4b9e-876f-63f0061e31a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:23.553609 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.553552    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:23.687243 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.687219    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"]
Jul 14 19:48:23.690046 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:48:23.690022    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78af5547_8f6c_4b9e_876f_63f0061e31a2.slice/crio-2d615cdde7c2f54524275c65f5ed4f0809cf59abd1de5fac50dc5d82245586f3 WatchSource:0}: Error finding container 2d615cdde7c2f54524275c65f5ed4f0809cf59abd1de5fac50dc5d82245586f3: Status 404 returned error can't find the container with id 2d615cdde7c2f54524275c65f5ed4f0809cf59abd1de5fac50dc5d82245586f3
Jul 14 19:48:23.965534 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.965495    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"]
Jul 14 19:48:23.970240 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.970207    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"]
Jul 14 19:48:23.971333 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.971310    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:23.997914 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:23.997891    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"]
Jul 14 19:48:24.002095 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.002078    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:24.021390 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.021364    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"]
Jul 14 19:48:24.067941 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.067911    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3512ae55-ef56-4a85-afd8-be71b3c676c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r5k29\" (UID: \"3512ae55-ef56-4a85-afd8-be71b3c676c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:24.068093 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.068032    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc4vz\" (UniqueName: \"kubernetes.io/projected/3512ae55-ef56-4a85-afd8-be71b3c676c6-kube-api-access-wc4vz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r5k29\" (UID: \"3512ae55-ef56-4a85-afd8-be71b3c676c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:24.072722 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.072686    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:24.168889 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.168858    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3512ae55-ef56-4a85-afd8-be71b3c676c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r5k29\" (UID: \"3512ae55-ef56-4a85-afd8-be71b3c676c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:24.169058 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.168925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc4vz\" (UniqueName: \"kubernetes.io/projected/3512ae55-ef56-4a85-afd8-be71b3c676c6-kube-api-access-wc4vz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r5k29\" (UID: \"3512ae55-ef56-4a85-afd8-be71b3c676c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:24.169224 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.169197    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3512ae55-ef56-4a85-afd8-be71b3c676c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r5k29\" (UID: \"3512ae55-ef56-4a85-afd8-be71b3c676c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:24.179670 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.179646    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc4vz\" (UniqueName: \"kubernetes.io/projected/3512ae55-ef56-4a85-afd8-be71b3c676c6-kube-api-access-wc4vz\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-r5k29\" (UID: \"3512ae55-ef56-4a85-afd8-be71b3c676c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:24.313151 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.313083    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:24.491403 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.491371    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"]
Jul 14 19:48:24.523054 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:48:24.523025    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3512ae55_ef56_4a85_afd8_be71b3c676c6.slice/crio-2d72900f7512ac232fffc4becc76793a3b4fd5103e328838e033fcfaec3b7fb1 WatchSource:0}: Error finding container 2d72900f7512ac232fffc4becc76793a3b4fd5103e328838e033fcfaec3b7fb1: Status 404 returned error can't find the container with id 2d72900f7512ac232fffc4becc76793a3b4fd5103e328838e033fcfaec3b7fb1
Jul 14 19:48:24.611408 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:24.611335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29" event={"ID":"3512ae55-ef56-4a85-afd8-be71b3c676c6","Type":"ContainerStarted","Data":"2d72900f7512ac232fffc4becc76793a3b4fd5103e328838e033fcfaec3b7fb1"}
Jul 14 19:48:28.822450 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:28.822412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:28.920463 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:28.920440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:29.635465 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:29.635432    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29" event={"ID":"3512ae55-ef56-4a85-afd8-be71b3c676c6","Type":"ContainerStarted","Data":"61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b"}
Jul 14 19:48:29.635647 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:29.635571    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:29.637075 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:29.637052    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2" podUID="78af5547-8f6c-4b9e-876f-63f0061e31a2" containerName="manager" containerID="cri-o://390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538" gracePeriod=2
Jul 14 19:48:29.656754 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:29.656711    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29" podStartSLOduration=2.246457102 podStartE2EDuration="6.656678821s" totalImagesPullingTime="4.410221719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:48:29.654469478 +0000 UTC m=+634.711989017" watchObservedRunningTime="2026-07-14 19:48:29.656678821 +0000 UTC m=+634.714198360"
Jul 14 19:48:29.865717 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:29.865669    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:29.868162 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:48:29.868136    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sh7g2\" is forbidden: User \"system:node:ip-10-0-136-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-12.ec2.internal' and this object" podUID="78af5547-8f6c-4b9e-876f-63f0061e31a2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:29.918194 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:29.918127    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc4fd\" (UniqueName: \"kubernetes.io/projected/78af5547-8f6c-4b9e-876f-63f0061e31a2-kube-api-access-cc4fd\") pod \"78af5547-8f6c-4b9e-876f-63f0061e31a2\" (UID: \"78af5547-8f6c-4b9e-876f-63f0061e31a2\") "
Jul 14 19:48:29.918194 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:29.918187    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78af5547-8f6c-4b9e-876f-63f0061e31a2-extensions-socket-volume\") pod \"78af5547-8f6c-4b9e-876f-63f0061e31a2\" (UID: \"78af5547-8f6c-4b9e-876f-63f0061e31a2\") "
Jul 14 19:48:29.918482 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:29.918461    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78af5547-8f6c-4b9e-876f-63f0061e31a2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "78af5547-8f6c-4b9e-876f-63f0061e31a2" (UID: "78af5547-8f6c-4b9e-876f-63f0061e31a2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:48:29.920236 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:29.920214    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78af5547-8f6c-4b9e-876f-63f0061e31a2-kube-api-access-cc4fd" (OuterVolumeSpecName: "kube-api-access-cc4fd") pod "78af5547-8f6c-4b9e-876f-63f0061e31a2" (UID: "78af5547-8f6c-4b9e-876f-63f0061e31a2"). InnerVolumeSpecName "kube-api-access-cc4fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:48:30.019672 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:30.019638    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/78af5547-8f6c-4b9e-876f-63f0061e31a2-extensions-socket-volume\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 19:48:30.019672 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:30.019672    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc4fd\" (UniqueName: \"kubernetes.io/projected/78af5547-8f6c-4b9e-876f-63f0061e31a2-kube-api-access-cc4fd\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 19:48:30.641963 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:30.641929    2569 generic.go:356] "Generic (PLEG): container finished" podID="78af5547-8f6c-4b9e-876f-63f0061e31a2" containerID="390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538" exitCode=2
Jul 14 19:48:30.642146 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:30.641974    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:30.642146 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:30.642037    2569 scope.go:117] "RemoveContainer" containerID="390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538"
Jul 14 19:48:30.644287 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:48:30.644258    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sh7g2\" is forbidden: User \"system:node:ip-10-0-136-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-12.ec2.internal' and this object" podUID="78af5547-8f6c-4b9e-876f-63f0061e31a2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:30.650499 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:30.650483    2569 scope.go:117] "RemoveContainer" containerID="390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538"
Jul 14 19:48:30.650754 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:48:30.650738    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538\": container with ID starting with 390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538 not found: ID does not exist" containerID="390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538"
Jul 14 19:48:30.650813 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:30.650763    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538"} err="failed to get container status \"390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538\": rpc error: code = NotFound desc = could not find container \"390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538\": container with ID starting with 390a72a699d4b9cda0293fad40e764f78d2a256ff92e416f1f9f14999a874538 not found: ID does not exist"
Jul 14 19:48:30.651928 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:48:30.651899    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sh7g2\" is forbidden: User \"system:node:ip-10-0-136-12.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-12.ec2.internal' and this object" podUID="78af5547-8f6c-4b9e-876f-63f0061e31a2" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sh7g2"
Jul 14 19:48:31.443738 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:31.443709    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78af5547-8f6c-4b9e-876f-63f0061e31a2" path="/var/lib/kubelet/pods/78af5547-8f6c-4b9e-876f-63f0061e31a2/volumes"
Jul 14 19:48:32.864607 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:32.864574    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:32.964640 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:32.964609    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:40.394494 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:40.394463    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:40.492015 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:40.491983    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:40.644338 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:40.644314    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:43.523375 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:43.523344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:44.033153 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:44.033126    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:44.133184 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:44.133155    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:46.397954 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:46.397921    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:46.466124 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:46.466100    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:47.033789 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:47.033756    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:47.108188 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:47.108158    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:53.185786 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.185751    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"]
Jul 14 19:48:53.186173 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.185954    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29" podUID="3512ae55-ef56-4a85-afd8-be71b3c676c6" containerName="manager" containerID="cri-o://61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b" gracePeriod=10
Jul 14 19:48:53.438550 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.438496    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:53.620184 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.620156    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc4vz\" (UniqueName: \"kubernetes.io/projected/3512ae55-ef56-4a85-afd8-be71b3c676c6-kube-api-access-wc4vz\") pod \"3512ae55-ef56-4a85-afd8-be71b3c676c6\" (UID: \"3512ae55-ef56-4a85-afd8-be71b3c676c6\") "
Jul 14 19:48:53.620356 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.620221    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3512ae55-ef56-4a85-afd8-be71b3c676c6-extensions-socket-volume\") pod \"3512ae55-ef56-4a85-afd8-be71b3c676c6\" (UID: \"3512ae55-ef56-4a85-afd8-be71b3c676c6\") "
Jul 14 19:48:53.620778 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.620745    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3512ae55-ef56-4a85-afd8-be71b3c676c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3512ae55-ef56-4a85-afd8-be71b3c676c6" (UID: "3512ae55-ef56-4a85-afd8-be71b3c676c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 19:48:53.622305 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.622289    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3512ae55-ef56-4a85-afd8-be71b3c676c6-kube-api-access-wc4vz" (OuterVolumeSpecName: "kube-api-access-wc4vz") pod "3512ae55-ef56-4a85-afd8-be71b3c676c6" (UID: "3512ae55-ef56-4a85-afd8-be71b3c676c6"). InnerVolumeSpecName "kube-api-access-wc4vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:48:53.720921 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.720828    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc4vz\" (UniqueName: \"kubernetes.io/projected/3512ae55-ef56-4a85-afd8-be71b3c676c6-kube-api-access-wc4vz\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 19:48:53.720921 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.720866    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3512ae55-ef56-4a85-afd8-be71b3c676c6-extensions-socket-volume\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 19:48:53.734473 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.734418    2569 generic.go:356] "Generic (PLEG): container finished" podID="3512ae55-ef56-4a85-afd8-be71b3c676c6" containerID="61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b" exitCode=0
Jul 14 19:48:53.734473 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.734468    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"
Jul 14 19:48:53.734659 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.734510    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29" event={"ID":"3512ae55-ef56-4a85-afd8-be71b3c676c6","Type":"ContainerDied","Data":"61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b"}
Jul 14 19:48:53.734659 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.734568    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29" event={"ID":"3512ae55-ef56-4a85-afd8-be71b3c676c6","Type":"ContainerDied","Data":"2d72900f7512ac232fffc4becc76793a3b4fd5103e328838e033fcfaec3b7fb1"}
Jul 14 19:48:53.734659 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.734622    2569 scope.go:117] "RemoveContainer" containerID="61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b"
Jul 14 19:48:53.743210 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.743191    2569 scope.go:117] "RemoveContainer" containerID="61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b"
Jul 14 19:48:53.743448 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:48:53.743433    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b\": container with ID starting with 61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b not found: ID does not exist" containerID="61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b"
Jul 14 19:48:53.743498 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.743456    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b"} err="failed to get container status \"61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b\": rpc error: code = NotFound desc = could not find container \"61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b\": container with ID starting with 61d5af99c170fe6a8b55d4dc9f1a4a11f6d0f77550dcf0ea080c22ad7c2cc42b not found: ID does not exist"
Jul 14 19:48:53.755919 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.755897    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"]
Jul 14 19:48:53.762001 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:53.761981    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-r5k29"]
Jul 14 19:48:55.443435 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:55.443405    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3512ae55-ef56-4a85-afd8-be71b3c676c6" path="/var/lib/kubelet/pods/3512ae55-ef56-4a85-afd8-be71b3c676c6/volumes"
Jul 14 19:48:57.236847 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:57.236816    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:48:57.589667 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:48:57.589581    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:03.907757 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:03.907727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:04.008770 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:04.008741    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:04.587980 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:04.587948    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:05.804006 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:05.803968    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:05.865925 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:05.865870    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:11.869253 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.869219    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t57wn"]
Jul 14 19:49:11.869627 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.869511    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3512ae55-ef56-4a85-afd8-be71b3c676c6" containerName="manager"
Jul 14 19:49:11.869627 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.869522    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3512ae55-ef56-4a85-afd8-be71b3c676c6" containerName="manager"
Jul 14 19:49:11.869627 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.869531    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78af5547-8f6c-4b9e-876f-63f0061e31a2" containerName="manager"
Jul 14 19:49:11.869627 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.869537    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="78af5547-8f6c-4b9e-876f-63f0061e31a2" containerName="manager"
Jul 14 19:49:11.869627 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.869587    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3512ae55-ef56-4a85-afd8-be71b3c676c6" containerName="manager"
Jul 14 19:49:11.869627 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.869595    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="78af5547-8f6c-4b9e-876f-63f0061e31a2" containerName="manager"
Jul 14 19:49:11.875175 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.875157    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:11.877950 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.877927    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 19:49:11.879078 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.879052    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 19:49:11.879180 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.879106    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 19:49:11.879180 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.879121    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j6wm7\""
Jul 14 19:49:11.881212 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.881185    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t57wn"]
Jul 14 19:49:11.951621 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.951592    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e06bdf9-1821-4832-ba85-100dc2acc825-config-file\") pod \"limitador-limitador-64c94fd64f-t57wn\" (UID: \"3e06bdf9-1821-4832-ba85-100dc2acc825\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:11.951778 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.951637    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2pcl\" (UniqueName: \"kubernetes.io/projected/3e06bdf9-1821-4832-ba85-100dc2acc825-kube-api-access-s2pcl\") pod \"limitador-limitador-64c94fd64f-t57wn\" (UID: \"3e06bdf9-1821-4832-ba85-100dc2acc825\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:11.966379 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:11.966345    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t57wn"]
Jul 14 19:49:12.052048 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:12.052022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e06bdf9-1821-4832-ba85-100dc2acc825-config-file\") pod \"limitador-limitador-64c94fd64f-t57wn\" (UID: \"3e06bdf9-1821-4832-ba85-100dc2acc825\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:12.052193 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:12.052057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2pcl\" (UniqueName: \"kubernetes.io/projected/3e06bdf9-1821-4832-ba85-100dc2acc825-kube-api-access-s2pcl\") pod \"limitador-limitador-64c94fd64f-t57wn\" (UID: \"3e06bdf9-1821-4832-ba85-100dc2acc825\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:12.052688 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:12.052669    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e06bdf9-1821-4832-ba85-100dc2acc825-config-file\") pod \"limitador-limitador-64c94fd64f-t57wn\" (UID: \"3e06bdf9-1821-4832-ba85-100dc2acc825\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:12.060492 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:12.060470    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2pcl\" (UniqueName: \"kubernetes.io/projected/3e06bdf9-1821-4832-ba85-100dc2acc825-kube-api-access-s2pcl\") pod \"limitador-limitador-64c94fd64f-t57wn\" (UID: \"3e06bdf9-1821-4832-ba85-100dc2acc825\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:12.186581 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:12.186544    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:12.312098 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:12.312074    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t57wn"]
Jul 14 19:49:12.314332 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:49:12.314304    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e06bdf9_1821_4832_ba85_100dc2acc825.slice/crio-94b66dbca45801a3c88140d080fcae913696f70c52c9f0bf7bb7cd0ca8f0d25c WatchSource:0}: Error finding container 94b66dbca45801a3c88140d080fcae913696f70c52c9f0bf7bb7cd0ca8f0d25c: Status 404 returned error can't find the container with id 94b66dbca45801a3c88140d080fcae913696f70c52c9f0bf7bb7cd0ca8f0d25c
Jul 14 19:49:12.802992 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:12.802952    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn" event={"ID":"3e06bdf9-1821-4832-ba85-100dc2acc825","Type":"ContainerStarted","Data":"94b66dbca45801a3c88140d080fcae913696f70c52c9f0bf7bb7cd0ca8f0d25c"}
Jul 14 19:49:13.103173 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:13.103096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:13.201521 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:13.201486    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:15.493579 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:15.493546    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:15.558554 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:15.558526    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:15.654276 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:15.654249    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:15.816439 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:15.816364    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn" event={"ID":"3e06bdf9-1821-4832-ba85-100dc2acc825","Type":"ContainerStarted","Data":"6af9ac8630e850a7ad0566ac790baef567ff89278e1d013f88679abb80feb12e"}
Jul 14 19:49:15.816577 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:15.816508    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:15.847128 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:15.847077    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn" podStartSLOduration=1.594986233 podStartE2EDuration="4.847063467s" totalImagesPullingTime="3.252077234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:49:15.845475636 +0000 UTC m=+680.902995175" watchObservedRunningTime="2026-07-14 19:49:15.847063467 +0000 UTC m=+680.904583009"
Jul 14 19:49:26.821707 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:26.821662    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:27.391390 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:27.391355    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t57wn"]
Jul 14 19:49:27.391621 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:27.391575    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn" podUID="3e06bdf9-1821-4832-ba85-100dc2acc825" containerName="limitador" containerID="cri-o://6af9ac8630e850a7ad0566ac790baef567ff89278e1d013f88679abb80feb12e" gracePeriod=30
Jul 14 19:49:27.860907 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:27.860873    2569 generic.go:356] "Generic (PLEG): container finished" podID="3e06bdf9-1821-4832-ba85-100dc2acc825" containerID="6af9ac8630e850a7ad0566ac790baef567ff89278e1d013f88679abb80feb12e" exitCode=0
Jul 14 19:49:27.861202 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:27.860920    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn" event={"ID":"3e06bdf9-1821-4832-ba85-100dc2acc825","Type":"ContainerDied","Data":"6af9ac8630e850a7ad0566ac790baef567ff89278e1d013f88679abb80feb12e"}
Jul 14 19:49:27.933408 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:27.933386    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:27.982273 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:27.982204    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2pcl\" (UniqueName: \"kubernetes.io/projected/3e06bdf9-1821-4832-ba85-100dc2acc825-kube-api-access-s2pcl\") pod \"3e06bdf9-1821-4832-ba85-100dc2acc825\" (UID: \"3e06bdf9-1821-4832-ba85-100dc2acc825\") "
Jul 14 19:49:27.982273 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:27.982242    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e06bdf9-1821-4832-ba85-100dc2acc825-config-file\") pod \"3e06bdf9-1821-4832-ba85-100dc2acc825\" (UID: \"3e06bdf9-1821-4832-ba85-100dc2acc825\") "
Jul 14 19:49:27.982620 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:27.982594    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e06bdf9-1821-4832-ba85-100dc2acc825-config-file" (OuterVolumeSpecName: "config-file") pod "3e06bdf9-1821-4832-ba85-100dc2acc825" (UID: "3e06bdf9-1821-4832-ba85-100dc2acc825"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 19:49:27.984171 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:27.984142    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e06bdf9-1821-4832-ba85-100dc2acc825-kube-api-access-s2pcl" (OuterVolumeSpecName: "kube-api-access-s2pcl") pod "3e06bdf9-1821-4832-ba85-100dc2acc825" (UID: "3e06bdf9-1821-4832-ba85-100dc2acc825"). InnerVolumeSpecName "kube-api-access-s2pcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:49:28.083762 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:28.083729    2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3e06bdf9-1821-4832-ba85-100dc2acc825-config-file\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 19:49:28.083762 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:28.083758    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2pcl\" (UniqueName: \"kubernetes.io/projected/3e06bdf9-1821-4832-ba85-100dc2acc825-kube-api-access-s2pcl\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 19:49:28.865346 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:28.865317    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn"
Jul 14 19:49:28.865346 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:28.865339    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t57wn" event={"ID":"3e06bdf9-1821-4832-ba85-100dc2acc825","Type":"ContainerDied","Data":"94b66dbca45801a3c88140d080fcae913696f70c52c9f0bf7bb7cd0ca8f0d25c"}
Jul 14 19:49:28.865883 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:28.865392    2569 scope.go:117] "RemoveContainer" containerID="6af9ac8630e850a7ad0566ac790baef567ff89278e1d013f88679abb80feb12e"
Jul 14 19:49:28.886041 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:28.886013    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t57wn"]
Jul 14 19:49:28.892565 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:28.892542    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t57wn"]
Jul 14 19:49:29.443979 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:29.443948    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e06bdf9-1821-4832-ba85-100dc2acc825" path="/var/lib/kubelet/pods/3e06bdf9-1821-4832-ba85-100dc2acc825/volumes"
Jul 14 19:49:31.051029 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.050989    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:31.147277 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.147251    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:31.532155 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.532121    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"]
Jul 14 19:49:31.532493 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.532474    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e06bdf9-1821-4832-ba85-100dc2acc825" containerName="limitador"
Jul 14 19:49:31.532493 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.532493    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e06bdf9-1821-4832-ba85-100dc2acc825" containerName="limitador"
Jul 14 19:49:31.532632 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.532556    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e06bdf9-1821-4832-ba85-100dc2acc825" containerName="limitador"
Jul 14 19:49:31.538744 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.538228    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"
Jul 14 19:49:31.540680 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.540654    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 14 19:49:31.540819 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.540657    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-p5dwp\""
Jul 14 19:49:31.541434 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.541415    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 14 19:49:31.541530 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.541467    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 14 19:49:31.546541 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.546523    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"]
Jul 14 19:49:31.613729 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.613687    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/991a2196-b426-4e2e-96d5-741015e631c5-data\") pod \"postgres-69fb4594cf-dm92x\" (UID: \"991a2196-b426-4e2e-96d5-741015e631c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"
Jul 14 19:49:31.613820 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.613757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl8rz\" (UniqueName: \"kubernetes.io/projected/991a2196-b426-4e2e-96d5-741015e631c5-kube-api-access-wl8rz\") pod \"postgres-69fb4594cf-dm92x\" (UID: \"991a2196-b426-4e2e-96d5-741015e631c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"
Jul 14 19:49:31.714573 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.714541    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/991a2196-b426-4e2e-96d5-741015e631c5-data\") pod \"postgres-69fb4594cf-dm92x\" (UID: \"991a2196-b426-4e2e-96d5-741015e631c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"
Jul 14 19:49:31.714752 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.714587    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl8rz\" (UniqueName: \"kubernetes.io/projected/991a2196-b426-4e2e-96d5-741015e631c5-kube-api-access-wl8rz\") pod \"postgres-69fb4594cf-dm92x\" (UID: \"991a2196-b426-4e2e-96d5-741015e631c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"
Jul 14 19:49:31.714936 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.714917    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/991a2196-b426-4e2e-96d5-741015e631c5-data\") pod \"postgres-69fb4594cf-dm92x\" (UID: \"991a2196-b426-4e2e-96d5-741015e631c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"
Jul 14 19:49:31.725540 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.725515    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl8rz\" (UniqueName: \"kubernetes.io/projected/991a2196-b426-4e2e-96d5-741015e631c5-kube-api-access-wl8rz\") pod \"postgres-69fb4594cf-dm92x\" (UID: \"991a2196-b426-4e2e-96d5-741015e631c5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"
Jul 14 19:49:31.849783 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.849710    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"
Jul 14 19:49:31.985830 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:31.985800    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"]
Jul 14 19:49:31.988472 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:49:31.988433    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991a2196_b426_4e2e_96d5_741015e631c5.slice/crio-905f644eb0badb3d9fdf2c5a6251b3f4cfa68a3c15f6097c2c13472d755a10dc WatchSource:0}: Error finding container 905f644eb0badb3d9fdf2c5a6251b3f4cfa68a3c15f6097c2c13472d755a10dc: Status 404 returned error can't find the container with id 905f644eb0badb3d9fdf2c5a6251b3f4cfa68a3c15f6097c2c13472d755a10dc
Jul 14 19:49:32.865057 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:32.865031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:32.882879 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:32.882847    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x" event={"ID":"991a2196-b426-4e2e-96d5-741015e631c5","Type":"ContainerStarted","Data":"905f644eb0badb3d9fdf2c5a6251b3f4cfa68a3c15f6097c2c13472d755a10dc"}
Jul 14 19:49:37.905819 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:37.905786    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x" event={"ID":"991a2196-b426-4e2e-96d5-741015e631c5","Type":"ContainerStarted","Data":"6db6cc990e32905e94d520f25f409f939ec5331ba48d51cb8ab89b9af6b5caaa"}
Jul 14 19:49:37.906191 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:37.905919    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"
Jul 14 19:49:37.925883 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:37.925813    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x" podStartSLOduration=1.758956327 podStartE2EDuration="6.925798594s" totalImagesPullingTime="5.166842267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:49:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:49:37.924383922 +0000 UTC m=+702.981903481" watchObservedRunningTime="2026-07-14 19:49:37.925798594 +0000 UTC m=+702.983318133"
Jul 14 19:49:43.938443 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:43.938413    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dm92x"
Jul 14 19:49:44.290745 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:44.290644    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:44.477463 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:44.477429    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:51.028610 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.028541    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-959bdb455-94fm2"]
Jul 14 19:49:51.032420 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.032400    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:49:51.035132 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.035103    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 19:49:51.035241 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.035146    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tvmpv\""
Jul 14 19:49:51.035241 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.035166    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 19:49:51.045559 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.045531    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-959bdb455-94fm2"]
Jul 14 19:49:51.097673 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.097642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:51.159469 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.159440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:51.176576 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.176552    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q55zg\" (UniqueName: \"kubernetes.io/projected/f78f0102-0fff-4bb1-9026-95abeaaeab89-kube-api-access-q55zg\") pod \"maas-controller-959bdb455-94fm2\" (UID: \"f78f0102-0fff-4bb1-9026-95abeaaeab89\") " pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:49:51.176648 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.176589    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f78f0102-0fff-4bb1-9026-95abeaaeab89-webhook-cert\") pod \"maas-controller-959bdb455-94fm2\" (UID: \"f78f0102-0fff-4bb1-9026-95abeaaeab89\") " pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:49:51.218525 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.218496    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5966dd7959-lqw74"]
Jul 14 19:49:51.220460 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.220444    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:49:51.230081 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.230055    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5966dd7959-lqw74"]
Jul 14 19:49:51.277798 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.277775    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q55zg\" (UniqueName: \"kubernetes.io/projected/f78f0102-0fff-4bb1-9026-95abeaaeab89-kube-api-access-q55zg\") pod \"maas-controller-959bdb455-94fm2\" (UID: \"f78f0102-0fff-4bb1-9026-95abeaaeab89\") " pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:49:51.277891 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.277811    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f78f0102-0fff-4bb1-9026-95abeaaeab89-webhook-cert\") pod \"maas-controller-959bdb455-94fm2\" (UID: \"f78f0102-0fff-4bb1-9026-95abeaaeab89\") " pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:49:51.280147 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.280093    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f78f0102-0fff-4bb1-9026-95abeaaeab89-webhook-cert\") pod \"maas-controller-959bdb455-94fm2\" (UID: \"f78f0102-0fff-4bb1-9026-95abeaaeab89\") " pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:49:51.285987 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.285962    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q55zg\" (UniqueName: \"kubernetes.io/projected/f78f0102-0fff-4bb1-9026-95abeaaeab89-kube-api-access-q55zg\") pod \"maas-controller-959bdb455-94fm2\" (UID: \"f78f0102-0fff-4bb1-9026-95abeaaeab89\") " pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:49:51.342961 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.342930    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:49:51.378783 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.378750    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48wdd\" (UniqueName: \"kubernetes.io/projected/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-kube-api-access-48wdd\") pod \"maas-controller-5966dd7959-lqw74\" (UID: \"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd\") " pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:49:51.378907 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.378796    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-webhook-cert\") pod \"maas-controller-5966dd7959-lqw74\" (UID: \"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd\") " pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:49:51.467105 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.467075    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-959bdb455-94fm2"]
Jul 14 19:49:51.469926 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:49:51.469903    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78f0102_0fff_4bb1_9026_95abeaaeab89.slice/crio-a1c591a56a0e957f6a28447658722bd2b356b7030b629e0e44342fb3a5561e41 WatchSource:0}: Error finding container a1c591a56a0e957f6a28447658722bd2b356b7030b629e0e44342fb3a5561e41: Status 404 returned error can't find the container with id a1c591a56a0e957f6a28447658722bd2b356b7030b629e0e44342fb3a5561e41
Jul 14 19:49:51.480233 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.480210    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wdd\" (UniqueName: \"kubernetes.io/projected/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-kube-api-access-48wdd\") pod \"maas-controller-5966dd7959-lqw74\" (UID: \"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd\") " pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:49:51.480322 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.480241    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-webhook-cert\") pod \"maas-controller-5966dd7959-lqw74\" (UID: \"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd\") " pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:49:51.482424 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.482407    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-webhook-cert\") pod \"maas-controller-5966dd7959-lqw74\" (UID: \"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd\") " pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:49:51.489373 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.489353    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48wdd\" (UniqueName: \"kubernetes.io/projected/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-kube-api-access-48wdd\") pod \"maas-controller-5966dd7959-lqw74\" (UID: \"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd\") " pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:49:51.530409 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.530354    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:49:51.653585 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.653554    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5966dd7959-lqw74"]
Jul 14 19:49:51.657006 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:49:51.656984    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3557de_f5b1_4ef0_ab1b_b3e974dd82fd.slice/crio-6984e644e395988d5b1cb78634f03420ca9c337be7b034def8398f4d9245981f WatchSource:0}: Error finding container 6984e644e395988d5b1cb78634f03420ca9c337be7b034def8398f4d9245981f: Status 404 returned error can't find the container with id 6984e644e395988d5b1cb78634f03420ca9c337be7b034def8398f4d9245981f
Jul 14 19:49:51.961543 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.961506    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5966dd7959-lqw74" event={"ID":"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd","Type":"ContainerStarted","Data":"6984e644e395988d5b1cb78634f03420ca9c337be7b034def8398f4d9245981f"}
Jul 14 19:49:51.962570 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:51.962547    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-959bdb455-94fm2" event={"ID":"f78f0102-0fff-4bb1-9026-95abeaaeab89","Type":"ContainerStarted","Data":"a1c591a56a0e957f6a28447658722bd2b356b7030b629e0e44342fb3a5561e41"}
Jul 14 19:49:54.723325 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:54.723288    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:54.833198 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:54.833112    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:49:54.976824 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:54.976793    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5966dd7959-lqw74" event={"ID":"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd","Type":"ContainerStarted","Data":"5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e"}
Jul 14 19:49:54.976979 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:54.976852    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:49:54.978268 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:54.978237    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-959bdb455-94fm2" event={"ID":"f78f0102-0fff-4bb1-9026-95abeaaeab89","Type":"ContainerStarted","Data":"63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492"}
Jul 14 19:49:54.978364 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:54.978327    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:49:54.995277 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:54.995235    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5966dd7959-lqw74" podStartSLOduration=1.16002459 podStartE2EDuration="3.995222153s" totalImagesPullingTime="2.835197563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:49:54.99422523 +0000 UTC m=+720.051744770" watchObservedRunningTime="2026-07-14 19:49:54.995222153 +0000 UTC m=+720.052741729"
Jul 14 19:49:55.013626 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:49:55.013584    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-959bdb455-94fm2" podStartSLOduration=0.990732002 podStartE2EDuration="4.013569928s" totalImagesPullingTime="3.022837926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:49:55.013150373 +0000 UTC m=+720.070669896" watchObservedRunningTime="2026-07-14 19:49:55.013569928 +0000 UTC m=+720.071089468"
Jul 14 19:50:05.984128 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:05.984096    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:50:05.984621 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:05.984177    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:50:06.041641 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:06.041608    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-959bdb455-94fm2"]
Jul 14 19:50:06.041823 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:06.041793    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-959bdb455-94fm2" podUID="f78f0102-0fff-4bb1-9026-95abeaaeab89" containerName="manager" containerID="cri-o://63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492" gracePeriod=30
Jul 14 19:50:06.277339 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:06.277317    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:50:06.404043 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:06.404009    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q55zg\" (UniqueName: \"kubernetes.io/projected/f78f0102-0fff-4bb1-9026-95abeaaeab89-kube-api-access-q55zg\") pod \"f78f0102-0fff-4bb1-9026-95abeaaeab89\" (UID: \"f78f0102-0fff-4bb1-9026-95abeaaeab89\") "
Jul 14 19:50:06.404043 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:06.404046    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f78f0102-0fff-4bb1-9026-95abeaaeab89-webhook-cert\") pod \"f78f0102-0fff-4bb1-9026-95abeaaeab89\" (UID: \"f78f0102-0fff-4bb1-9026-95abeaaeab89\") "
Jul 14 19:50:06.406313 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:06.406287    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f78f0102-0fff-4bb1-9026-95abeaaeab89-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f78f0102-0fff-4bb1-9026-95abeaaeab89" (UID: "f78f0102-0fff-4bb1-9026-95abeaaeab89"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:50:06.406390 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:06.406288    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f78f0102-0fff-4bb1-9026-95abeaaeab89-kube-api-access-q55zg" (OuterVolumeSpecName: "kube-api-access-q55zg") pod "f78f0102-0fff-4bb1-9026-95abeaaeab89" (UID: "f78f0102-0fff-4bb1-9026-95abeaaeab89"). InnerVolumeSpecName "kube-api-access-q55zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:50:06.505493 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:06.505461    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q55zg\" (UniqueName: \"kubernetes.io/projected/f78f0102-0fff-4bb1-9026-95abeaaeab89-kube-api-access-q55zg\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 19:50:06.505493 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:06.505489    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f78f0102-0fff-4bb1-9026-95abeaaeab89-webhook-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 19:50:07.029382 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:07.029350    2569 generic.go:356] "Generic (PLEG): container finished" podID="f78f0102-0fff-4bb1-9026-95abeaaeab89" containerID="63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492" exitCode=0
Jul 14 19:50:07.029875 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:07.029399    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-959bdb455-94fm2"
Jul 14 19:50:07.029875 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:07.029441    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-959bdb455-94fm2" event={"ID":"f78f0102-0fff-4bb1-9026-95abeaaeab89","Type":"ContainerDied","Data":"63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492"}
Jul 14 19:50:07.029875 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:07.029493    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-959bdb455-94fm2" event={"ID":"f78f0102-0fff-4bb1-9026-95abeaaeab89","Type":"ContainerDied","Data":"a1c591a56a0e957f6a28447658722bd2b356b7030b629e0e44342fb3a5561e41"}
Jul 14 19:50:07.029875 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:07.029515    2569 scope.go:117] "RemoveContainer" containerID="63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492"
Jul 14 19:50:07.037908 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:07.037892    2569 scope.go:117] "RemoveContainer" containerID="63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492"
Jul 14 19:50:07.038152 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:50:07.038136    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492\": container with ID starting with 63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492 not found: ID does not exist" containerID="63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492"
Jul 14 19:50:07.038206 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:07.038159    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492"} err="failed to get container status \"63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492\": rpc error: code = NotFound desc = could not find container \"63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492\": container with ID starting with 63a717eb68fa10580976d467c1190a0edbea429f04e6135289b3b412a56a9492 not found: ID does not exist"
Jul 14 19:50:07.050615 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:07.050592    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-959bdb455-94fm2"]
Jul 14 19:50:07.055737 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:07.055718    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-959bdb455-94fm2"]
Jul 14 19:50:07.445022 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:07.444991    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f78f0102-0fff-4bb1-9026-95abeaaeab89" path="/var/lib/kubelet/pods/f78f0102-0fff-4bb1-9026-95abeaaeab89/volumes"
Jul 14 19:50:26.484608 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:26.484572    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:50:26.582960 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:26.582921    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:50:27.110613 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.110579    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:50:27.111354 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.111332    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"]
Jul 14 19:50:27.111729 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.111712    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78f0102-0fff-4bb1-9026-95abeaaeab89" containerName="manager"
Jul 14 19:50:27.111796 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.111732    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78f0102-0fff-4bb1-9026-95abeaaeab89" containerName="manager"
Jul 14 19:50:27.111846 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.111834    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f78f0102-0fff-4bb1-9026-95abeaaeab89" containerName="manager"
Jul 14 19:50:27.114989 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.114972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.118602 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.118584    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 14 19:50:27.145811 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.145790    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"]
Jul 14 19:50:27.151038 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.151010    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43e332a1-ce10-40f5-9af1-d4204210d1c3-maas-api-tls\") pod \"maas-api-8559b688dd-gmn9q\" (UID: \"43e332a1-ce10-40f5-9af1-d4204210d1c3\") " pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.151155 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.151060    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43e332a1-ce10-40f5-9af1-d4204210d1c3-openshift-service-ca\") pod \"maas-api-8559b688dd-gmn9q\" (UID: \"43e332a1-ce10-40f5-9af1-d4204210d1c3\") " pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.151211 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.151186    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk576\" (UniqueName: \"kubernetes.io/projected/43e332a1-ce10-40f5-9af1-d4204210d1c3-kube-api-access-wk576\") pod \"maas-api-8559b688dd-gmn9q\" (UID: \"43e332a1-ce10-40f5-9af1-d4204210d1c3\") " pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.252183 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.252158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43e332a1-ce10-40f5-9af1-d4204210d1c3-maas-api-tls\") pod \"maas-api-8559b688dd-gmn9q\" (UID: \"43e332a1-ce10-40f5-9af1-d4204210d1c3\") " pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.252279 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.252189    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43e332a1-ce10-40f5-9af1-d4204210d1c3-openshift-service-ca\") pod \"maas-api-8559b688dd-gmn9q\" (UID: \"43e332a1-ce10-40f5-9af1-d4204210d1c3\") " pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.252336 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:50:27.252304    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 14 19:50:27.252336 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.252323    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk576\" (UniqueName: \"kubernetes.io/projected/43e332a1-ce10-40f5-9af1-d4204210d1c3-kube-api-access-wk576\") pod \"maas-api-8559b688dd-gmn9q\" (UID: \"43e332a1-ce10-40f5-9af1-d4204210d1c3\") " pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.252414 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:50:27.252364    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43e332a1-ce10-40f5-9af1-d4204210d1c3-maas-api-tls podName:43e332a1-ce10-40f5-9af1-d4204210d1c3 nodeName:}" failed. No retries permitted until 2026-07-14 19:50:27.75234903 +0000 UTC m=+752.809868549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/43e332a1-ce10-40f5-9af1-d4204210d1c3-maas-api-tls") pod "maas-api-8559b688dd-gmn9q" (UID: "43e332a1-ce10-40f5-9af1-d4204210d1c3") : secret "maas-api-serving-cert" not found
Jul 14 19:50:27.252836 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.252816    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/43e332a1-ce10-40f5-9af1-d4204210d1c3-openshift-service-ca\") pod \"maas-api-8559b688dd-gmn9q\" (UID: \"43e332a1-ce10-40f5-9af1-d4204210d1c3\") " pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.264583 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.264565    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk576\" (UniqueName: \"kubernetes.io/projected/43e332a1-ce10-40f5-9af1-d4204210d1c3-kube-api-access-wk576\") pod \"maas-api-8559b688dd-gmn9q\" (UID: \"43e332a1-ce10-40f5-9af1-d4204210d1c3\") " pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.625556 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.625489    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:50:27.724289 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.724246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:50:27.751845 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.751818    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"]
Jul 14 19:50:27.757599 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.757577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43e332a1-ce10-40f5-9af1-d4204210d1c3-maas-api-tls\") pod \"maas-api-8559b688dd-gmn9q\" (UID: \"43e332a1-ce10-40f5-9af1-d4204210d1c3\") " pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.759835 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.759817    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"
Jul 14 19:50:27.759928 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.759889    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/43e332a1-ce10-40f5-9af1-d4204210d1c3-maas-api-tls\") pod \"maas-api-8559b688dd-gmn9q\" (UID: \"43e332a1-ce10-40f5-9af1-d4204210d1c3\") " pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:27.762884 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.762866    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 14 19:50:27.763160 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.763143    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pxtt6\""
Jul 14 19:50:27.773746 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.773723    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"]
Jul 14 19:50:27.858051 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.858019    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcztc\" (UniqueName: \"kubernetes.io/projected/8388398d-30b1-47d1-865c-814b4dc41753-kube-api-access-qcztc\") pod \"payload-processing-f9b8d9b9b-6bxvm\" (UID: \"8388398d-30b1-47d1-865c-814b4dc41753\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"
Jul 14 19:50:27.858051 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.858055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8388398d-30b1-47d1-865c-814b4dc41753-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-6bxvm\" (UID: \"8388398d-30b1-47d1-865c-814b4dc41753\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"
Jul 14 19:50:27.892005 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.891931    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:50:27.959189 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.959153    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcztc\" (UniqueName: \"kubernetes.io/projected/8388398d-30b1-47d1-865c-814b4dc41753-kube-api-access-qcztc\") pod \"payload-processing-f9b8d9b9b-6bxvm\" (UID: \"8388398d-30b1-47d1-865c-814b4dc41753\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"
Jul 14 19:50:27.959355 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.959199    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8388398d-30b1-47d1-865c-814b4dc41753-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-6bxvm\" (UID: \"8388398d-30b1-47d1-865c-814b4dc41753\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"
Jul 14 19:50:27.959909 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.959884    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8388398d-30b1-47d1-865c-814b4dc41753-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-6bxvm\" (UID: \"8388398d-30b1-47d1-865c-814b4dc41753\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"
Jul 14 19:50:27.967596 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:27.967569    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcztc\" (UniqueName: \"kubernetes.io/projected/8388398d-30b1-47d1-865c-814b4dc41753-kube-api-access-qcztc\") pod \"payload-processing-f9b8d9b9b-6bxvm\" (UID: \"8388398d-30b1-47d1-865c-814b4dc41753\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"
Jul 14 19:50:28.025083 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:28.025051    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:28.077436 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:28.077409    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"
Jul 14 19:50:28.179728 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:28.179679    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"]
Jul 14 19:50:28.181411 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:50:28.181377    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e332a1_ce10_40f5_9af1_d4204210d1c3.slice/crio-132f83260c62ecdc9ed72e6304ed6a87e8ec1a64742f3a6c0aebdfee1e053d95 WatchSource:0}: Error finding container 132f83260c62ecdc9ed72e6304ed6a87e8ec1a64742f3a6c0aebdfee1e053d95: Status 404 returned error can't find the container with id 132f83260c62ecdc9ed72e6304ed6a87e8ec1a64742f3a6c0aebdfee1e053d95
Jul 14 19:50:28.215228 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:28.215202    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"]
Jul 14 19:50:28.216945 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:50:28.216917    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8388398d_30b1_47d1_865c_814b4dc41753.slice/crio-8cda31a3d5dd2448ca89f7f6a3d1af78d90c04c63b4a24fe4305b08402a347ae WatchSource:0}: Error finding container 8cda31a3d5dd2448ca89f7f6a3d1af78d90c04c63b4a24fe4305b08402a347ae: Status 404 returned error can't find the container with id 8cda31a3d5dd2448ca89f7f6a3d1af78d90c04c63b4a24fe4305b08402a347ae
Jul 14 19:50:29.122030 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:29.121996    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm" event={"ID":"8388398d-30b1-47d1-865c-814b4dc41753","Type":"ContainerStarted","Data":"8cda31a3d5dd2448ca89f7f6a3d1af78d90c04c63b4a24fe4305b08402a347ae"}
Jul 14 19:50:29.123177 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:29.123147    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q" event={"ID":"43e332a1-ce10-40f5-9af1-d4204210d1c3","Type":"ContainerStarted","Data":"132f83260c62ecdc9ed72e6304ed6a87e8ec1a64742f3a6c0aebdfee1e053d95"}
Jul 14 19:50:31.132418 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:31.132385    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm" event={"ID":"8388398d-30b1-47d1-865c-814b4dc41753","Type":"ContainerStarted","Data":"cb6f0ab33e8dda5f8e9d2723890ccfe16caa89536cd26501fb5e1edb383a4a37"}
Jul 14 19:50:31.132896 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:31.132485    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"
Jul 14 19:50:31.182051 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:31.182000    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm" podStartSLOduration=1.412796521 podStartE2EDuration="4.181985996s" totalImagesPullingTime="2.769189475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:50:31.180747822 +0000 UTC m=+756.238267361" watchObservedRunningTime="2026-07-14 19:50:31.181985996 +0000 UTC m=+756.239505536"
Jul 14 19:50:33.144195 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:33.144154    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q" event={"ID":"43e332a1-ce10-40f5-9af1-d4204210d1c3","Type":"ContainerStarted","Data":"882cb892d70038292522bc094a2882a6b20a0758058eb79510387cbc3fb9a632"}
Jul 14 19:50:33.144588 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:33.144246    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:33.170922 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:33.170878    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q" podStartSLOduration=1.97653284 podStartE2EDuration="6.170864425s" totalImagesPullingTime="4.194331585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:50:33.170727297 +0000 UTC m=+758.228246837" watchObservedRunningTime="2026-07-14 19:50:33.170864425 +0000 UTC m=+758.228383964"
Jul 14 19:50:39.154204 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:39.154174    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8559b688dd-gmn9q"
Jul 14 19:50:40.275597 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:40.275557    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:50:40.372343 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:40.372308    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:50:42.140817 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:42.140789    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-6bxvm"
Jul 14 19:50:49.223790 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.223756    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"]
Jul 14 19:50:49.227106 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.227090    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.233785 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.233764    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 19:50:49.234108 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.233763    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c2bvl\""
Jul 14 19:50:49.234262 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.233785    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 14 19:50:49.235141 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.233815    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 19:50:49.242956 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.242936    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:50:49.292242 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.292216    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"]
Jul 14 19:50:49.333962 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.333936    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.334096 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.333971    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e092756-5c55-4eff-8631-24f34039ed09-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.334096 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.333993    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr6ll\" (UniqueName: \"kubernetes.io/projected/2e092756-5c55-4eff-8631-24f34039ed09-kube-api-access-tr6ll\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.334096 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.334022    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.334096 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.334060    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.334232 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.334131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.435200 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.435168    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e092756-5c55-4eff-8631-24f34039ed09-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.435200 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.435204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr6ll\" (UniqueName: \"kubernetes.io/projected/2e092756-5c55-4eff-8631-24f34039ed09-kube-api-access-tr6ll\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.435376 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.435230    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.435376 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.435255    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.435376 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.435309    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.435516 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.435391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.435760 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.435740    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.435832 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.435761    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.435832 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.435819    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.437391 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.437371    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e092756-5c55-4eff-8631-24f34039ed09-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.437847 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.437827    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e092756-5c55-4eff-8631-24f34039ed09-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.445740 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.445717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr6ll\" (UniqueName: \"kubernetes.io/projected/2e092756-5c55-4eff-8631-24f34039ed09-kube-api-access-tr6ll\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk\" (UID: \"2e092756-5c55-4eff-8631-24f34039ed09\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.539010 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.538934    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:49.685785 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:49.685761    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"]
Jul 14 19:50:49.687824 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:50:49.687793    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e092756_5c55_4eff_8631_24f34039ed09.slice/crio-979829dceefe57c385242da73378ccf2256f8b91c4a3c42ce0fec6f409946a60 WatchSource:0}: Error finding container 979829dceefe57c385242da73378ccf2256f8b91c4a3c42ce0fec6f409946a60: Status 404 returned error can't find the container with id 979829dceefe57c385242da73378ccf2256f8b91c4a3c42ce0fec6f409946a60
Jul 14 19:50:50.224721 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:50.224619    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk" event={"ID":"2e092756-5c55-4eff-8631-24f34039ed09","Type":"ContainerStarted","Data":"979829dceefe57c385242da73378ccf2256f8b91c4a3c42ce0fec6f409946a60"}
Jul 14 19:50:51.230247 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:51.230212    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk" event={"ID":"2e092756-5c55-4eff-8631-24f34039ed09","Type":"ContainerStarted","Data":"b0ad7edc2209d6cbef6164fa8ff02589817c8fe93efeb249a2b1f3235af060b3"}
Jul 14 19:50:51.251670 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:51.251619    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk" podStartSLOduration=1.094475773 podStartE2EDuration="2.251606083s" totalImagesPullingTime="1.15713031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:50:51.249778754 +0000 UTC m=+776.307298296" watchObservedRunningTime="2026-07-14 19:50:51.251606083 +0000 UTC m=+776.309125623"
Jul 14 19:50:55.168676 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:55.168644    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:50:59.539421 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:59.539380    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:59.539931 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:59.539458    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:50:59.551732 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:50:59.551683    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:51:00.277625 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:51:00.277598    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk"
Jul 14 19:51:03.107461 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:51:03.107340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:51:15.859780 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:51:15.859742    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:51:19.798859 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:51:19.798765    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:51:21.508347 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:51:21.508314    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:51:28.574357 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:51:28.574326    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:51:35.356437 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:51:35.356402    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:13.201783 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:52:13.201747    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:13.281515 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:52:13.281486    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:35.508131 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:52:35.508091    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:35.601538 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:52:35.601498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:36.721963 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:52:36.721928    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:38.057767 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:52:38.057737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:52:55.408494 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:52:55.408465    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:52:55.410065 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:52:55.410044    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:53:28.007586 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:28.007550    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:48.940077 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:48.940050    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:49.038138 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.038091    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5966dd7959-lqw74"]
Jul 14 19:53:49.038353 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.038312    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5966dd7959-lqw74" podUID="bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd" containerName="manager" containerID="cri-o://5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e" gracePeriod=30
Jul 14 19:53:49.284620 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.284596    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:53:49.395840 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.395815    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-webhook-cert\") pod \"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd\" (UID: \"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd\") "
Jul 14 19:53:49.395990 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.395871    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48wdd\" (UniqueName: \"kubernetes.io/projected/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-kube-api-access-48wdd\") pod \"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd\" (UID: \"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd\") "
Jul 14 19:53:49.397896 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.397863    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd" (UID: "bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 19:53:49.397990 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.397862    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-kube-api-access-48wdd" (OuterVolumeSpecName: "kube-api-access-48wdd") pod "bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd" (UID: "bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd"). InnerVolumeSpecName "kube-api-access-48wdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 19:53:49.497312 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.497249    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48wdd\" (UniqueName: \"kubernetes.io/projected/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-kube-api-access-48wdd\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 19:53:49.497312 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.497273    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd-webhook-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 19:53:49.961810 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.961778    2569 generic.go:356] "Generic (PLEG): container finished" podID="bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd" containerID="5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e" exitCode=0
Jul 14 19:53:49.962192 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.961834    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5966dd7959-lqw74"
Jul 14 19:53:49.962192 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.961852    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5966dd7959-lqw74" event={"ID":"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd","Type":"ContainerDied","Data":"5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e"}
Jul 14 19:53:49.962192 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.961899    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5966dd7959-lqw74" event={"ID":"bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd","Type":"ContainerDied","Data":"6984e644e395988d5b1cb78634f03420ca9c337be7b034def8398f4d9245981f"}
Jul 14 19:53:49.962192 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.961920    2569 scope.go:117] "RemoveContainer" containerID="5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e"
Jul 14 19:53:49.970245 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.970225    2569 scope.go:117] "RemoveContainer" containerID="5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e"
Jul 14 19:53:49.970524 ip-10-0-136-12 kubenswrapper[2569]: E0714 19:53:49.970499    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e\": container with ID starting with 5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e not found: ID does not exist" containerID="5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e"
Jul 14 19:53:49.970580 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.970539    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e"} err="failed to get container status \"5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e\": rpc error: code = NotFound desc = could not find container \"5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e\": container with ID starting with 5065ca8abba1688355f1e046142adb9e61a6b741715808745999e3e56232a06e not found: ID does not exist"
Jul 14 19:53:49.979909 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.979887    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5966dd7959-lqw74"]
Jul 14 19:53:49.986257 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:49.986239    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5966dd7959-lqw74"]
Jul 14 19:53:50.696918 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.696864    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:53:50.811840 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.811810    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5966dd7959-k56ng"]
Jul 14 19:53:50.814529 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.812879    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd" containerName="manager"
Jul 14 19:53:50.814529 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.812909    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd" containerName="manager"
Jul 14 19:53:50.814529 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.813049    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd" containerName="manager"
Jul 14 19:53:50.818284 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.818260    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5966dd7959-k56ng"
Jul 14 19:53:50.820849 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.820829    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 19:53:50.821744 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.821728    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tvmpv\""
Jul 14 19:53:50.821808 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.821737    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 19:53:50.826956 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.826934    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5966dd7959-k56ng"]
Jul 14 19:53:50.909987 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.909964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgq8z\" (UniqueName: \"kubernetes.io/projected/71162aad-28af-4e45-bc07-66fd822f049d-kube-api-access-jgq8z\") pod \"maas-controller-5966dd7959-k56ng\" (UID: \"71162aad-28af-4e45-bc07-66fd822f049d\") " pod="opendatahub/maas-controller-5966dd7959-k56ng"
Jul 14 19:53:50.910120 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:50.910004    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71162aad-28af-4e45-bc07-66fd822f049d-webhook-cert\") pod \"maas-controller-5966dd7959-k56ng\" (UID: \"71162aad-28af-4e45-bc07-66fd822f049d\") " pod="opendatahub/maas-controller-5966dd7959-k56ng"
Jul 14 19:53:51.010938 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:51.010869    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgq8z\" (UniqueName: \"kubernetes.io/projected/71162aad-28af-4e45-bc07-66fd822f049d-kube-api-access-jgq8z\") pod \"maas-controller-5966dd7959-k56ng\" (UID: \"71162aad-28af-4e45-bc07-66fd822f049d\") " pod="opendatahub/maas-controller-5966dd7959-k56ng"
Jul 14 19:53:51.010938 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:51.010902    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71162aad-28af-4e45-bc07-66fd822f049d-webhook-cert\") pod \"maas-controller-5966dd7959-k56ng\" (UID: \"71162aad-28af-4e45-bc07-66fd822f049d\") " pod="opendatahub/maas-controller-5966dd7959-k56ng"
Jul 14 19:53:51.013166 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:51.013147    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71162aad-28af-4e45-bc07-66fd822f049d-webhook-cert\") pod \"maas-controller-5966dd7959-k56ng\" (UID: \"71162aad-28af-4e45-bc07-66fd822f049d\") " pod="opendatahub/maas-controller-5966dd7959-k56ng"
Jul 14 19:53:51.019402 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:51.019380    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgq8z\" (UniqueName: \"kubernetes.io/projected/71162aad-28af-4e45-bc07-66fd822f049d-kube-api-access-jgq8z\") pod \"maas-controller-5966dd7959-k56ng\" (UID: \"71162aad-28af-4e45-bc07-66fd822f049d\") " pod="opendatahub/maas-controller-5966dd7959-k56ng"
Jul 14 19:53:51.129246 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:51.129220    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5966dd7959-k56ng"
Jul 14 19:53:51.253434 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:51.253393    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5966dd7959-k56ng"]
Jul 14 19:53:51.255584 ip-10-0-136-12 kubenswrapper[2569]: W0714 19:53:51.255550    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71162aad_28af_4e45_bc07_66fd822f049d.slice/crio-131bed0c5bf4c0ac83255149b6e1666afa062b05c060ca9398e9efb5133b06cd WatchSource:0}: Error finding container 131bed0c5bf4c0ac83255149b6e1666afa062b05c060ca9398e9efb5133b06cd: Status 404 returned error can't find the container with id 131bed0c5bf4c0ac83255149b6e1666afa062b05c060ca9398e9efb5133b06cd
Jul 14 19:53:51.256892 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:51.256872    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 19:53:51.444244 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:51.444222    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd" path="/var/lib/kubelet/pods/bf3557de-f5b1-4ef0-ab1b-b3e974dd82fd/volumes"
Jul 14 19:53:51.972651 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:51.972617    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5966dd7959-k56ng" event={"ID":"71162aad-28af-4e45-bc07-66fd822f049d","Type":"ContainerStarted","Data":"131bed0c5bf4c0ac83255149b6e1666afa062b05c060ca9398e9efb5133b06cd"}
Jul 14 19:53:52.978118 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:52.978084    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5966dd7959-k56ng" event={"ID":"71162aad-28af-4e45-bc07-66fd822f049d","Type":"ContainerStarted","Data":"cd40cc341582cba0e7229547d0b601f7cf740cc478e5e1033f184b05b2f3aa07"}
Jul 14 19:53:52.978491 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:52.978217    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5966dd7959-k56ng"
Jul 14 19:53:52.995583 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:53:52.995537    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5966dd7959-k56ng" podStartSLOduration=1.910047928 podStartE2EDuration="2.995522806s" totalImagesPullingTime="1.085474878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:53:52.994723532 +0000 UTC m=+958.052243073" watchObservedRunningTime="2026-07-14 19:53:52.995522806 +0000 UTC m=+958.053042346"
Jul 14 19:54:03.985437 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:54:03.985405    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5966dd7959-k56ng"
Jul 14 19:54:37.356110 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:54:37.356018    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:37.619278 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:54:37.619182    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:37.828466 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:54:37.828430    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:43.381903 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:54:43.381873    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:46.575995 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:54:46.575951    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:46.973231 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:54:46.973201    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:47.485253 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:54:47.485221    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:54.463129 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:54:54.463093    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:54:54.702210 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:54:54.702165    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:56:41.248170 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:56:41.248139    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:17.724492 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:57:17.724420    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:57:55.432666 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:57:55.432637    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:57:55.435039 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:57:55.435015    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 19:58:24.039870 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:58:24.039835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 19:58:24.140155 ip-10-0-136-12 kubenswrapper[2569]: I0714 19:58:24.140122    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:01:14.376974 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:01:14.376935    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:02:55.457779 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:02:55.457749    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:02:55.459217 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:02:55.459191    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:03:42.472204 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:03:42.472172    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:03:42.567024 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:03:42.566995    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:04:20.553859 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:04:20.553821    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:04:20.657074 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:04:20.657037    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:04:21.122843 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:04:21.122813    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:05.280892 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:05.280838    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:12.836181 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:12.836149    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:21.151756 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:21.151656    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:26.280464 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:26.280416    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:29.475959 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:29.475928    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:29.570939 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:29.570906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:29.928784 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:29.928750    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:36.474523 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:36.474489    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:36.577062 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:36.577025    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:36.722505 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:36.722476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:36.793181 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:36.793075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:37.926427 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:37.926392    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:38.028593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.028562    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"]
Jul 14 20:06:38.030911 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.030884    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:38.032181 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.032165    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.034668 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.034649    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ffd1ab16-serving-cert\""
Jul 14 20:06:38.034830 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.034779    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfc6h\""
Jul 14 20:06:38.046222 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.046199    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"]
Jul 14 20:06:38.122599 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.122568    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a5be276-1102-48ee-9946-13c9d716b008-openshift-service-ca\") pod \"maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.122783 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.122607    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a5be276-1102-48ee-9946-13c9d716b008-maas-api-tls\") pod \"maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.122783 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.122665    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d8vr\" (UniqueName: \"kubernetes.io/projected/2a5be276-1102-48ee-9946-13c9d716b008-kube-api-access-9d8vr\") pod \"maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.224006 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.223934    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a5be276-1102-48ee-9946-13c9d716b008-openshift-service-ca\") pod \"maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.224006 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.223981    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a5be276-1102-48ee-9946-13c9d716b008-maas-api-tls\") pod \"maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.224189 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.224029    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d8vr\" (UniqueName: \"kubernetes.io/projected/2a5be276-1102-48ee-9946-13c9d716b008-kube-api-access-9d8vr\") pod \"maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.224659 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.224637    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a5be276-1102-48ee-9946-13c9d716b008-openshift-service-ca\") pod \"maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.226453 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.226424    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a5be276-1102-48ee-9946-13c9d716b008-maas-api-tls\") pod \"maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.235038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.235016    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d8vr\" (UniqueName: \"kubernetes.io/projected/2a5be276-1102-48ee-9946-13c9d716b008-kube-api-access-9d8vr\") pod \"maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.342449 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.342416    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:38.480561 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.480533    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"]
Jul 14 20:06:38.482378 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:06:38.482352    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5be276_1102_48ee_9946_13c9d716b008.slice/crio-3c7862c22c7927c54a9a5d5f0b62c61fd1465c129c5a1a2f3105a4c97638fbbb WatchSource:0}: Error finding container 3c7862c22c7927c54a9a5d5f0b62c61fd1465c129c5a1a2f3105a4c97638fbbb: Status 404 returned error can't find the container with id 3c7862c22c7927c54a9a5d5f0b62c61fd1465c129c5a1a2f3105a4c97638fbbb
Jul 14 20:06:38.483763 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:38.483743    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:06:39.111048 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:39.111014    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z" event={"ID":"2a5be276-1102-48ee-9946-13c9d716b008","Type":"ContainerStarted","Data":"3c7862c22c7927c54a9a5d5f0b62c61fd1465c129c5a1a2f3105a4c97638fbbb"}
Jul 14 20:06:39.643606 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:39.643579    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:39.744111 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:39.744064    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:40.651675 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:40.651647    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:06:41.120491 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:41.120454    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z" event={"ID":"2a5be276-1102-48ee-9946-13c9d716b008","Type":"ContainerStarted","Data":"d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48"}
Jul 14 20:06:41.120656 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:41.120599    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:41.144715 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:41.144652    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z" podStartSLOduration=1.014677042 podStartE2EDuration="3.144635702s" totalImagesPullingTime="2.12995866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:06:41.1424501 +0000 UTC m=+1726.199969640" watchObservedRunningTime="2026-07-14 20:06:41.144635702 +0000 UTC m=+1726.202155244"
Jul 14 20:06:47.130983 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:47.130951    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:06:59.475876 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:06:59.475841    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:07:53.866387 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:53.866347    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"]
Jul 14 20:07:53.866881 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:53.866615    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z" podUID="2a5be276-1102-48ee-9946-13c9d716b008" containerName="maas-api" containerID="cri-o://d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48" gracePeriod=30
Jul 14 20:07:53.916049 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:53.916022    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:07:54.113154 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.113130    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:07:54.249030 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.248999    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a5be276-1102-48ee-9946-13c9d716b008-maas-api-tls\") pod \"2a5be276-1102-48ee-9946-13c9d716b008\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") "
Jul 14 20:07:54.249207 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.249050    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a5be276-1102-48ee-9946-13c9d716b008-openshift-service-ca\") pod \"2a5be276-1102-48ee-9946-13c9d716b008\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") "
Jul 14 20:07:54.249207 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.249092    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d8vr\" (UniqueName: \"kubernetes.io/projected/2a5be276-1102-48ee-9946-13c9d716b008-kube-api-access-9d8vr\") pod \"2a5be276-1102-48ee-9946-13c9d716b008\" (UID: \"2a5be276-1102-48ee-9946-13c9d716b008\") "
Jul 14 20:07:54.249458 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.249439    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a5be276-1102-48ee-9946-13c9d716b008-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a5be276-1102-48ee-9946-13c9d716b008" (UID: "2a5be276-1102-48ee-9946-13c9d716b008"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:07:54.251311 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.251277    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a5be276-1102-48ee-9946-13c9d716b008-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a5be276-1102-48ee-9946-13c9d716b008" (UID: "2a5be276-1102-48ee-9946-13c9d716b008"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:07:54.251413 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.251306    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a5be276-1102-48ee-9946-13c9d716b008-kube-api-access-9d8vr" (OuterVolumeSpecName: "kube-api-access-9d8vr") pod "2a5be276-1102-48ee-9946-13c9d716b008" (UID: "2a5be276-1102-48ee-9946-13c9d716b008"). InnerVolumeSpecName "kube-api-access-9d8vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:07:54.350189 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.350139    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d8vr\" (UniqueName: \"kubernetes.io/projected/2a5be276-1102-48ee-9946-13c9d716b008-kube-api-access-9d8vr\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:07:54.350189 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.350183    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a5be276-1102-48ee-9946-13c9d716b008-maas-api-tls\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:07:54.350189 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.350196    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a5be276-1102-48ee-9946-13c9d716b008-openshift-service-ca\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:07:54.423593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.423559    2569 generic.go:356] "Generic (PLEG): container finished" podID="2a5be276-1102-48ee-9946-13c9d716b008" containerID="d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48" exitCode=0
Jul 14 20:07:54.423750 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.423602    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z" event={"ID":"2a5be276-1102-48ee-9946-13c9d716b008","Type":"ContainerDied","Data":"d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48"}
Jul 14 20:07:54.423750 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.423609    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"
Jul 14 20:07:54.423750 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.423654    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z" event={"ID":"2a5be276-1102-48ee-9946-13c9d716b008","Type":"ContainerDied","Data":"3c7862c22c7927c54a9a5d5f0b62c61fd1465c129c5a1a2f3105a4c97638fbbb"}
Jul 14 20:07:54.423750 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.423684    2569 scope.go:117] "RemoveContainer" containerID="d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48"
Jul 14 20:07:54.432295 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.432266    2569 scope.go:117] "RemoveContainer" containerID="d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48"
Jul 14 20:07:54.432504 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:07:54.432488    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48\": container with ID starting with d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48 not found: ID does not exist" containerID="d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48"
Jul 14 20:07:54.432556 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.432512    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48"} err="failed to get container status \"d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48\": rpc error: code = NotFound desc = could not find container \"d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48\": container with ID starting with d43edd817fc627661f4ff0bc635a5ea407ddbe5c78171336dcdcfa1491a67c48 not found: ID does not exist"
Jul 14 20:07:54.445164 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.445136    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"]
Jul 14 20:07:54.450686 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:54.450665    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ffd1ab16-d959cbbb8-rgq2z"]
Jul 14 20:07:55.444633 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:55.444603    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a5be276-1102-48ee-9946-13c9d716b008" path="/var/lib/kubelet/pods/2a5be276-1102-48ee-9946-13c9d716b008/volumes"
Jul 14 20:07:55.483356 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:55.483331    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:07:55.484040 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:55.484019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:07:58.163131 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:07:58.163090    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:04.506011 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:04.505982    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:04.588661 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:04.588633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:08.375409 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:08.375373    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:08.957817 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:08.957592    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"]
Jul 14 20:08:08.957952 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:08.957937    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a5be276-1102-48ee-9946-13c9d716b008" containerName="maas-api"
Jul 14 20:08:08.957952 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:08.957954    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a5be276-1102-48ee-9946-13c9d716b008" containerName="maas-api"
Jul 14 20:08:08.958075 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:08.958037    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a5be276-1102-48ee-9946-13c9d716b008" containerName="maas-api"
Jul 14 20:08:08.961078 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:08.961051    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:08.964585 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:08.964561    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-dec8aa7c-gw-openshift-default-dockercfg-m8gw8\""
Jul 14 20:08:08.991340 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:08.991318    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"]
Jul 14 20:08:09.075407 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.075375    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-socket\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.075582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.075422    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-data\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.075582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.075454    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-certs\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.075582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.075473    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-envoy\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.075582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.075496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istiod-ca-cert\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.075582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.075519    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-credential-socket\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.075582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.075535    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-podinfo\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.075582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.075583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-token\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.075832 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.075600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjds8\" (UniqueName: \"kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-kube-api-access-tjds8\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.176430 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.176396    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-envoy\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.176610 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.176441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istiod-ca-cert\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.176610 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.176471    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-credential-socket\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.176610 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.176491    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-podinfo\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.176610 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.176521    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-token\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.176610 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.176537    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjds8\" (UniqueName: \"kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-kube-api-access-tjds8\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.176610 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.176569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-socket\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.177056 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.176631    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-data\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.177056 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.176749    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-certs\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.177056 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.176948    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-credential-socket\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.177056 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.177003    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-socket\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.177260 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.177054    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-certs\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.177260 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.177104    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-data\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.177359 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.177323    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istiod-ca-cert\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.178755 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.178736    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-envoy\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.179164 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.179148    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-podinfo\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.184924 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.184901    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-token\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.185092 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.185073    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjds8\" (UniqueName: \"kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-kube-api-access-tjds8\") pod \"e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") " pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.272066 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.272002    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:09.409760 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.409733    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"]
Jul 14 20:08:09.412296 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:08:09.412268    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39558c8_8d5b_4e2d_9d43_876131dd5dd6.slice/crio-41b21161c78bf9c018782eb3de23785e479e71d1e905798d223b76a15071ccae WatchSource:0}: Error finding container 41b21161c78bf9c018782eb3de23785e479e71d1e905798d223b76a15071ccae: Status 404 returned error can't find the container with id 41b21161c78bf9c018782eb3de23785e479e71d1e905798d223b76a15071ccae
Jul 14 20:08:09.485487 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.485457    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" event={"ID":"e39558c8-8d5b-4e2d-9d43-876131dd5dd6","Type":"ContainerStarted","Data":"41b21161c78bf9c018782eb3de23785e479e71d1e905798d223b76a15071ccae"}
Jul 14 20:08:09.858314 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.858282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:09.941618 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:09.941588    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:10.357525 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.357475    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:10.506120 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.506086    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"]
Jul 14 20:08:10.509867 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.509832    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:10.516382 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.516355    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-dec8aa7c-serving-cert\""
Jul 14 20:08:10.516503 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.516442    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfc6h\""
Jul 14 20:08:10.534588 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.534563    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"]
Jul 14 20:08:10.598547 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.598516    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:10.689844 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.689811    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79qkl\" (UniqueName: \"kubernetes.io/projected/d1db626d-a802-45b3-ad1d-268f97b552e3-kube-api-access-79qkl\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:10.690037 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.689855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:10.690037 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.689898    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1db626d-a802-45b3-ad1d-268f97b552e3-openshift-service-ca\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:10.791392 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.791359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:10.791568 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.791408    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1db626d-a802-45b3-ad1d-268f97b552e3-openshift-service-ca\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:10.791568 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.791515    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79qkl\" (UniqueName: \"kubernetes.io/projected/d1db626d-a802-45b3-ad1d-268f97b552e3-kube-api-access-79qkl\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:10.791685 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:08:10.791565    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-serving-cert: secret "maas-api-e2e-migrate-dec8aa7c-serving-cert" not found
Jul 14 20:08:10.791685 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:08:10.791675    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls podName:d1db626d-a802-45b3-ad1d-268f97b552e3 nodeName:}" failed. No retries permitted until 2026-07-14 20:08:11.291651947 +0000 UTC m=+1816.349171464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls") pod "maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55" (UID: "d1db626d-a802-45b3-ad1d-268f97b552e3") : secret "maas-api-e2e-migrate-dec8aa7c-serving-cert" not found
Jul 14 20:08:10.792250 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.792225    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1db626d-a802-45b3-ad1d-268f97b552e3-openshift-service-ca\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:10.804026 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:10.804003    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79qkl\" (UniqueName: \"kubernetes.io/projected/d1db626d-a802-45b3-ad1d-268f97b552e3-kube-api-access-79qkl\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:11.191570 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:11.191529    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:11.296008 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:11.295969    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:11.296232 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:11.296204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:11.296375 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:08:11.296356    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-serving-cert: secret "maas-api-e2e-migrate-dec8aa7c-serving-cert" not found
Jul 14 20:08:11.296457 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:08:11.296444    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls podName:d1db626d-a802-45b3-ad1d-268f97b552e3 nodeName:}" failed. No retries permitted until 2026-07-14 20:08:12.296423017 +0000 UTC m=+1817.353942537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls") pod "maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55" (UID: "d1db626d-a802-45b3-ad1d-268f97b552e3") : secret "maas-api-e2e-migrate-dec8aa7c-serving-cert" not found
Jul 14 20:08:11.432797 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:11.432759    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:12.036523 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:12.036487    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:08:12.036816 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:12.036556    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:08:12.036816 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:12.036586    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:08:12.305226 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:12.305140    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:12.307529 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:12.307502    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls\") pod \"maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:12.323579 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:12.323554    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:12.457585 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:12.457563    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"]
Jul 14 20:08:12.460362 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:08:12.460339    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1db626d_a802_45b3_ad1d_268f97b552e3.slice/crio-248fbe9f1432485e30f6d64dd7b157eb348e073fadc83c1e26ce736da417f4c6 WatchSource:0}: Error finding container 248fbe9f1432485e30f6d64dd7b157eb348e073fadc83c1e26ce736da417f4c6: Status 404 returned error can't find the container with id 248fbe9f1432485e30f6d64dd7b157eb348e073fadc83c1e26ce736da417f4c6
Jul 14 20:08:12.505589 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:12.505556    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" event={"ID":"e39558c8-8d5b-4e2d-9d43-876131dd5dd6","Type":"ContainerStarted","Data":"899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba"}
Jul 14 20:08:12.506608 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:12.506586    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55" event={"ID":"d1db626d-a802-45b3-ad1d-268f97b552e3","Type":"ContainerStarted","Data":"248fbe9f1432485e30f6d64dd7b157eb348e073fadc83c1e26ce736da417f4c6"}
Jul 14 20:08:12.527018 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:12.526936    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" podStartSLOduration=1.90498622 podStartE2EDuration="4.526920786s" totalImagesPullingTime="2.621934566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:08:12.525525447 +0000 UTC m=+1817.583044988" watchObservedRunningTime="2026-07-14 20:08:12.526920786 +0000 UTC m=+1817.584440327"
Jul 14 20:08:13.272211 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:13.272124    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:13.276794 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:13.276770    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:13.511418 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:13.511384    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55" event={"ID":"d1db626d-a802-45b3-ad1d-268f97b552e3","Type":"ContainerStarted","Data":"828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef"}
Jul 14 20:08:13.511647 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:13.511624    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:13.512467 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:13.512443    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:13.532605 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:13.532525    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55" podStartSLOduration=3.029053598 podStartE2EDuration="3.532510873s" totalImagesPullingTime="503.457275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:08:13.530418757 +0000 UTC m=+1818.587938296" watchObservedRunningTime="2026-07-14 20:08:13.532510873 +0000 UTC m=+1818.590030413"
Jul 14 20:08:14.515850 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:14.515816    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:20.410178 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:20.410151    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:20.481597 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:20.481563    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:20.532988 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:20.532953    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:08:24.001634 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:24.001593    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:08:26.573755 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:26.573721    2569 generic.go:356] "Generic (PLEG): container finished" podID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerID="899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba" exitCode=0
Jul 14 20:08:26.574146 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:26.573778    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" event={"ID":"e39558c8-8d5b-4e2d-9d43-876131dd5dd6","Type":"ContainerDied","Data":"899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba"}
Jul 14 20:08:26.574146 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:26.574111    2569 scope.go:117] "RemoveContainer" containerID="899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba"
Jul 14 20:08:26.575938 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:26.575910    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:08:26.575995 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:26.575977    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:08:26.576029 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:26.576009    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:08:27.579477 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:27.579449    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" event={"ID":"e39558c8-8d5b-4e2d-9d43-876131dd5dd6","Type":"ContainerStarted","Data":"8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83"}
Jul 14 20:08:28.272431 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:28.272398    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:28.273476 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:28.273451    2569 patch_prober.go:28] interesting pod/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 14 20:08:28.273574 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:28.273498    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 14 20:08:28.511869 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:28.511826    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:29.273006 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:29.272972    2569 patch_prober.go:28] interesting pod/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 14 20:08:29.273376 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:29.273029    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 14 20:08:30.272719 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:30.272664    2569 patch_prober.go:28] interesting pod/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 14 20:08:30.272876 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:30.272740    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 14 20:08:31.272875 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:31.272834    2569 patch_prober.go:28] interesting pod/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 14 20:08:31.273351 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:31.272903    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 14 20:08:32.276379 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:32.276348    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:08:32.277277 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:08:32.277257    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:09:14.366725 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:14.366669    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:14.469251 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:14.469226    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:14.923203 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:14.923172    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"]
Jul 14 20:09:14.923428 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:14.923402    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy" containerID="cri-o://8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83" gracePeriod=30
Jul 14 20:09:14.938498 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:14.938473    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:15.048504 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:15.048470    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:15.515935 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:15.515901    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:15.619236 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:15.619207    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:15.752513 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:15.752480    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"]
Jul 14 20:09:15.752757 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:15.752727    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55" podUID="d1db626d-a802-45b3-ad1d-268f97b552e3" containerName="maas-api" containerID="cri-o://828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef" gracePeriod=30
Jul 14 20:09:15.785753 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:15.785727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:15.996512 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:15.996491    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:09:16.036193 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.036135    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls\") pod \"d1db626d-a802-45b3-ad1d-268f97b552e3\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") "
Jul 14 20:09:16.036193 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.036177    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79qkl\" (UniqueName: \"kubernetes.io/projected/d1db626d-a802-45b3-ad1d-268f97b552e3-kube-api-access-79qkl\") pod \"d1db626d-a802-45b3-ad1d-268f97b552e3\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") "
Jul 14 20:09:16.036342 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.036202    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1db626d-a802-45b3-ad1d-268f97b552e3-openshift-service-ca\") pod \"d1db626d-a802-45b3-ad1d-268f97b552e3\" (UID: \"d1db626d-a802-45b3-ad1d-268f97b552e3\") "
Jul 14 20:09:16.036593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.036572    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1db626d-a802-45b3-ad1d-268f97b552e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1db626d-a802-45b3-ad1d-268f97b552e3" (UID: "d1db626d-a802-45b3-ad1d-268f97b552e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:09:16.038225 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.038200    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1db626d-a802-45b3-ad1d-268f97b552e3-kube-api-access-79qkl" (OuterVolumeSpecName: "kube-api-access-79qkl") pod "d1db626d-a802-45b3-ad1d-268f97b552e3" (UID: "d1db626d-a802-45b3-ad1d-268f97b552e3"). InnerVolumeSpecName "kube-api-access-79qkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:09:16.038225 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.038210    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1db626d-a802-45b3-ad1d-268f97b552e3" (UID: "d1db626d-a802-45b3-ad1d-268f97b552e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:09:16.137508 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.137476    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79qkl\" (UniqueName: \"kubernetes.io/projected/d1db626d-a802-45b3-ad1d-268f97b552e3-kube-api-access-79qkl\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:16.137508 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.137503    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1db626d-a802-45b3-ad1d-268f97b552e3-openshift-service-ca\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:16.137656 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.137514    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1db626d-a802-45b3-ad1d-268f97b552e3-maas-api-tls\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:16.790516 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.790433    2569 generic.go:356] "Generic (PLEG): container finished" podID="d1db626d-a802-45b3-ad1d-268f97b552e3" containerID="828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef" exitCode=0
Jul 14 20:09:16.790516 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.790477    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"
Jul 14 20:09:16.791032 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.790523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55" event={"ID":"d1db626d-a802-45b3-ad1d-268f97b552e3","Type":"ContainerDied","Data":"828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef"}
Jul 14 20:09:16.791032 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.790575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55" event={"ID":"d1db626d-a802-45b3-ad1d-268f97b552e3","Type":"ContainerDied","Data":"248fbe9f1432485e30f6d64dd7b157eb348e073fadc83c1e26ce736da417f4c6"}
Jul 14 20:09:16.791032 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.790597    2569 scope.go:117] "RemoveContainer" containerID="828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef"
Jul 14 20:09:16.804833 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.804810    2569 scope.go:117] "RemoveContainer" containerID="828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef"
Jul 14 20:09:16.805104 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:09:16.805083    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef\": container with ID starting with 828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef not found: ID does not exist" containerID="828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef"
Jul 14 20:09:16.805169 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.805109    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef"} err="failed to get container status \"828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef\": rpc error: code = NotFound desc = could not find container \"828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef\": container with ID starting with 828191a2aa89dce984f945a2c981ec7882722677e78f91455c87d9cd882e7fef not found: ID does not exist"
Jul 14 20:09:16.815494 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.815469    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"]
Jul 14 20:09:16.819850 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:16.819828    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec8aa7c-7f6b8b6dc8-vbq55"]
Jul 14 20:09:17.279099 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:17.279065    2569 patch_prober.go:28] interesting pod/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:09:17.279265 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:17.279127    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:09:17.445307 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:17.445275    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1db626d-a802-45b3-ad1d-268f97b552e3" path="/var/lib/kubelet/pods/d1db626d-a802-45b3-ad1d-268f97b552e3/volumes"
Jul 14 20:09:20.165332 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.165310    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:09:20.268801 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.268771    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjds8\" (UniqueName: \"kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-kube-api-access-tjds8\") pod \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") "
Jul 14 20:09:20.268979 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.268821    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-certs\") pod \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") "
Jul 14 20:09:20.268979 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.268865    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-token\") pod \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") "
Jul 14 20:09:20.268979 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.268896    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-podinfo\") pod \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") "
Jul 14 20:09:20.268979 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.268958    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-credential-socket\") pod \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") "
Jul 14 20:09:20.269195 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.268996    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istiod-ca-cert\") pod \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") "
Jul 14 20:09:20.269195 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.269023    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-envoy\") pod \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") "
Jul 14 20:09:20.269195 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.269058    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-data\") pod \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") "
Jul 14 20:09:20.269195 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.269089    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-socket\") pod \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\" (UID: \"e39558c8-8d5b-4e2d-9d43-876131dd5dd6\") "
Jul 14 20:09:20.269195 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.269157    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e39558c8-8d5b-4e2d-9d43-876131dd5dd6" (UID: "e39558c8-8d5b-4e2d-9d43-876131dd5dd6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:09:20.269429 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.269364    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e39558c8-8d5b-4e2d-9d43-876131dd5dd6" (UID: "e39558c8-8d5b-4e2d-9d43-876131dd5dd6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:09:20.269484 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.269429    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:20.269484 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.269449    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:20.269592 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.269531    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e39558c8-8d5b-4e2d-9d43-876131dd5dd6" (UID: "e39558c8-8d5b-4e2d-9d43-876131dd5dd6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:09:20.270042 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.269991    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e39558c8-8d5b-4e2d-9d43-876131dd5dd6" (UID: "e39558c8-8d5b-4e2d-9d43-876131dd5dd6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:09:20.270442 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.270290    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-data" (OuterVolumeSpecName: "istio-data") pod "e39558c8-8d5b-4e2d-9d43-876131dd5dd6" (UID: "e39558c8-8d5b-4e2d-9d43-876131dd5dd6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:09:20.271340 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.271316    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-kube-api-access-tjds8" (OuterVolumeSpecName: "kube-api-access-tjds8") pod "e39558c8-8d5b-4e2d-9d43-876131dd5dd6" (UID: "e39558c8-8d5b-4e2d-9d43-876131dd5dd6"). InnerVolumeSpecName "kube-api-access-tjds8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:09:20.271452 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.271402    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-token" (OuterVolumeSpecName: "istio-token") pod "e39558c8-8d5b-4e2d-9d43-876131dd5dd6" (UID: "e39558c8-8d5b-4e2d-9d43-876131dd5dd6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:09:20.271511 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.271488    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e39558c8-8d5b-4e2d-9d43-876131dd5dd6" (UID: "e39558c8-8d5b-4e2d-9d43-876131dd5dd6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:09:20.271590 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.271570    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e39558c8-8d5b-4e2d-9d43-876131dd5dd6" (UID: "e39558c8-8d5b-4e2d-9d43-876131dd5dd6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:09:20.370437 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.370408    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:20.370437 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.370434    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:20.370437 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.370442    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:20.370615 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.370450    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjds8\" (UniqueName: \"kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-kube-api-access-tjds8\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:20.370615 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.370458    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:20.370615 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.370466    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:20.370615 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.370473    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e39558c8-8d5b-4e2d-9d43-876131dd5dd6-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:09:20.809926 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.809897    2569 generic.go:356] "Generic (PLEG): container finished" podID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerID="8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83" exitCode=0
Jul 14 20:09:20.810083 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.809948    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"
Jul 14 20:09:20.810083 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.809956    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" event={"ID":"e39558c8-8d5b-4e2d-9d43-876131dd5dd6","Type":"ContainerDied","Data":"8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83"}
Jul 14 20:09:20.810083 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.809999    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv" event={"ID":"e39558c8-8d5b-4e2d-9d43-876131dd5dd6","Type":"ContainerDied","Data":"41b21161c78bf9c018782eb3de23785e479e71d1e905798d223b76a15071ccae"}
Jul 14 20:09:20.810083 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.810020    2569 scope.go:117] "RemoveContainer" containerID="8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83"
Jul 14 20:09:20.818383 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.818366    2569 scope.go:117] "RemoveContainer" containerID="899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba"
Jul 14 20:09:20.825590 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.825573    2569 scope.go:117] "RemoveContainer" containerID="8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83"
Jul 14 20:09:20.825841 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:09:20.825824    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83\": container with ID starting with 8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83 not found: ID does not exist" containerID="8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83"
Jul 14 20:09:20.825889 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.825849    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83"} err="failed to get container status \"8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83\": rpc error: code = NotFound desc = could not find container \"8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83\": container with ID starting with 8bf6739e4bc59c784f13f77ddbad7154de262f7bcb56918c2cd7deb14774da83 not found: ID does not exist"
Jul 14 20:09:20.825889 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.825865    2569 scope.go:117] "RemoveContainer" containerID="899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba"
Jul 14 20:09:20.826064 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:09:20.826048    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba\": container with ID starting with 899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba not found: ID does not exist" containerID="899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba"
Jul 14 20:09:20.826103 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.826071    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba"} err="failed to get container status \"899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba\": rpc error: code = NotFound desc = could not find container \"899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba\": container with ID starting with 899d0ea70af3813326984732b0bc90a37fb8974c7037d27a88cb9ef129cff6ba not found: ID does not exist"
Jul 14 20:09:20.831331 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.831310    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"]
Jul 14 20:09:20.835310 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:20.835291    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-dec8aa7c-gw-openshift-default-77d68d5dbc-sckbv"]
Jul 14 20:09:21.411132 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.411101    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:21.446120 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.446090    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" path="/var/lib/kubelet/pods/e39558c8-8d5b-4e2d-9d43-876131dd5dd6/volumes"
Jul 14 20:09:21.524189 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.524156    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:21.692423 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.692390    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"]
Jul 14 20:09:21.692768 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.692753    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy"
Jul 14 20:09:21.692834 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.692770    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy"
Jul 14 20:09:21.692834 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.692802    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1db626d-a802-45b3-ad1d-268f97b552e3" containerName="maas-api"
Jul 14 20:09:21.692834 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.692808    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1db626d-a802-45b3-ad1d-268f97b552e3" containerName="maas-api"
Jul 14 20:09:21.692834 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.692815    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy"
Jul 14 20:09:21.692834 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.692821    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy"
Jul 14 20:09:21.693107 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.692861    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy"
Jul 14 20:09:21.693107 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.692873    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e39558c8-8d5b-4e2d-9d43-876131dd5dd6" containerName="istio-proxy"
Jul 14 20:09:21.693107 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.692883    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1db626d-a802-45b3-ad1d-268f97b552e3" containerName="maas-api"
Jul 14 20:09:21.697389 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.697367    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.708428 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.708409    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0ac1fa23-openshift-default-dockercfg-46bw2\""
Jul 14 20:09:21.721552 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.721523    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"]
Jul 14 20:09:21.782670 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.782633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw6rk\" (UniqueName: \"kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-kube-api-access-tw6rk\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.782842 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.782710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-data\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.782842 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.782749    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-socket\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.782842 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.782808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-credential-socket\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.782842 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.782837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93671f9f-63a9-4eae-ad12-789868d7c40b-istiod-ca-cert\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.783015 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.782881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-podinfo\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.783015 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.782908    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-certs\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.783015 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.782937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-envoy\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.783015 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.782963    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-token\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.810376 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.810331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:21.884272 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884238    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw6rk\" (UniqueName: \"kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-kube-api-access-tw6rk\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884412 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884279    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-data\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884412 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884303    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-socket\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884412 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884392    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-credential-socket\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884568 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93671f9f-63a9-4eae-ad12-789868d7c40b-istiod-ca-cert\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884568 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-podinfo\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884672 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884579    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-certs\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884672 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884605    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-envoy\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884672 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884628    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-token\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884822 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884689    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-data\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884897 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884875    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-credential-socket\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.884999 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.884977    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-certs\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.885097 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.885079    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-socket\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.885143 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.885117    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93671f9f-63a9-4eae-ad12-789868d7c40b-istiod-ca-cert\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.886789 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.886770    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-envoy\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.887103 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.887082    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-podinfo\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.895414 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.895393    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-token\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.895615 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.895599    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw6rk\" (UniqueName: \"kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-kube-api-access-tw6rk\") pod \"e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") " pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:21.907591 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:21.907572    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:22.007102 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:22.007026    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:22.142887 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:22.142856    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"]
Jul 14 20:09:22.146132 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:09:22.146104    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93671f9f_63a9_4eae_ad12_789868d7c40b.slice/crio-c25901ccb43632c388a7020d097f5623405ce3255b3d23d179208a4fbf3b0f54 WatchSource:0}: Error finding container c25901ccb43632c388a7020d097f5623405ce3255b3d23d179208a4fbf3b0f54: Status 404 returned error can't find the container with id c25901ccb43632c388a7020d097f5623405ce3255b3d23d179208a4fbf3b0f54
Jul 14 20:09:22.148235 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:22.148204    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:09:22.148298 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:22.148288    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:09:22.148334 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:22.148320    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:09:22.820552 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:22.820520    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" event={"ID":"93671f9f-63a9-4eae-ad12-789868d7c40b","Type":"ContainerStarted","Data":"5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82"}
Jul 14 20:09:22.820940 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:22.820570    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" event={"ID":"93671f9f-63a9-4eae-ad12-789868d7c40b","Type":"ContainerStarted","Data":"c25901ccb43632c388a7020d097f5623405ce3255b3d23d179208a4fbf3b0f54"}
Jul 14 20:09:22.849919 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:22.849863    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" podStartSLOduration=1.849847424 podStartE2EDuration="1.849847424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:09:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:09:22.848562844 +0000 UTC m=+1887.906082397" watchObservedRunningTime="2026-07-14 20:09:22.849847424 +0000 UTC m=+1887.907366963"
Jul 14 20:09:22.920573 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:22.920543    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:23.007944 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.007917    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:23.012768 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.012748    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:23.030447 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.030415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:23.114282 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.114206    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"]
Jul 14 20:09:23.117503 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.117479    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.121361 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.121339    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0ac1fa23-serving-cert\""
Jul 14 20:09:23.121529 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.121512    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfc6h\""
Jul 14 20:09:23.138837 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.138816    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"]
Jul 14 20:09:23.176539 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.176517    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:23.195527 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.195501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clmzq\" (UniqueName: \"kubernetes.io/projected/affdf040-94f0-4d06-bd0e-90d3f568b126-kube-api-access-clmzq\") pod \"maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.195763 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.195545    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/affdf040-94f0-4d06-bd0e-90d3f568b126-openshift-service-ca\") pod \"maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.195763 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.195571    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affdf040-94f0-4d06-bd0e-90d3f568b126-maas-api-tls\") pod \"maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.296115 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.296089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clmzq\" (UniqueName: \"kubernetes.io/projected/affdf040-94f0-4d06-bd0e-90d3f568b126-kube-api-access-clmzq\") pod \"maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.296249 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.296140    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/affdf040-94f0-4d06-bd0e-90d3f568b126-openshift-service-ca\") pod \"maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.296249 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.296164    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affdf040-94f0-4d06-bd0e-90d3f568b126-maas-api-tls\") pod \"maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.296319 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:09:23.296254    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-serving-cert: secret "maas-api-e2e-ait-0ac1fa23-serving-cert" not found
Jul 14 20:09:23.296319 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:09:23.296309    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/affdf040-94f0-4d06-bd0e-90d3f568b126-maas-api-tls podName:affdf040-94f0-4d06-bd0e-90d3f568b126 nodeName:}" failed. No retries permitted until 2026-07-14 20:09:23.796289709 +0000 UTC m=+1888.853809229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/affdf040-94f0-4d06-bd0e-90d3f568b126-maas-api-tls") pod "maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m" (UID: "affdf040-94f0-4d06-bd0e-90d3f568b126") : secret "maas-api-e2e-ait-0ac1fa23-serving-cert" not found
Jul 14 20:09:23.296777 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.296757    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/affdf040-94f0-4d06-bd0e-90d3f568b126-openshift-service-ca\") pod \"maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.305035 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.305012    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clmzq\" (UniqueName: \"kubernetes.io/projected/affdf040-94f0-4d06-bd0e-90d3f568b126-kube-api-access-clmzq\") pod \"maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.801051 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.801017    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affdf040-94f0-4d06-bd0e-90d3f568b126-maas-api-tls\") pod \"maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.803536 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.803512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affdf040-94f0-4d06-bd0e-90d3f568b126-maas-api-tls\") pod \"maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:23.827166 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.827136    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:23.828086 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:23.828066    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:24.028307 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:24.028275    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:24.162344 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:24.162316    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"]
Jul 14 20:09:24.164549 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:09:24.164524    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaffdf040_94f0_4d06_bd0e_90d3f568b126.slice/crio-168234b492b1f0155d512ec307564b3a31fd83ed6ba2d154699d7c7b0e23e912 WatchSource:0}: Error finding container 168234b492b1f0155d512ec307564b3a31fd83ed6ba2d154699d7c7b0e23e912: Status 404 returned error can't find the container with id 168234b492b1f0155d512ec307564b3a31fd83ed6ba2d154699d7c7b0e23e912
Jul 14 20:09:24.487727 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:24.487683    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:24.587686 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:24.587653    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:24.833689 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:24.833660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m" event={"ID":"affdf040-94f0-4d06-bd0e-90d3f568b126","Type":"ContainerStarted","Data":"685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad"}
Jul 14 20:09:24.834139 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:24.833733    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m" event={"ID":"affdf040-94f0-4d06-bd0e-90d3f568b126","Type":"ContainerStarted","Data":"168234b492b1f0155d512ec307564b3a31fd83ed6ba2d154699d7c7b0e23e912"}
Jul 14 20:09:24.834139 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:24.833766    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:24.853002 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:24.852959    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m" podStartSLOduration=1.317586936 podStartE2EDuration="1.852943079s" totalImagesPullingTime="535.356143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:09:24.851259992 +0000 UTC m=+1889.908779532" watchObservedRunningTime="2026-07-14 20:09:24.852943079 +0000 UTC m=+1889.910462619"
Jul 14 20:09:25.006077 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:25.006006    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:09:30.842562 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:30.842536    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:09:37.892214 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:37.892183    2569 generic.go:356] "Generic (PLEG): container finished" podID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerID="5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82" exitCode=0
Jul 14 20:09:37.892619 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:37.892250    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" event={"ID":"93671f9f-63a9-4eae-ad12-789868d7c40b","Type":"ContainerDied","Data":"5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82"}
Jul 14 20:09:37.892619 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:37.892586    2569 scope.go:117] "RemoveContainer" containerID="5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82"
Jul 14 20:09:37.893538 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:37.893510    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:09:37.893590 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:37.893580    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:09:37.893625 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:37.893612    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:09:38.827110 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:38.827059    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:38.898033 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:38.897999    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" event={"ID":"93671f9f-63a9-4eae-ad12-789868d7c40b","Type":"ContainerStarted","Data":"6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f"}
Jul 14 20:09:39.007309 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:39.007278    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:39.008312 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:39.008287    2569 patch_prober.go:28] interesting pod/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 14 20:09:39.008412 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:39.008356    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 14 20:09:40.007527 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:40.007487    2569 patch_prober.go:28] interesting pod/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 14 20:09:40.007922 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:40.007541    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 14 20:09:41.008221 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:41.008184    2569 patch_prober.go:28] interesting pod/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 14 20:09:41.008601 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:41.008237    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 14 20:09:42.008293 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:42.008258    2569 patch_prober.go:28] interesting pod/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Jul 14 20:09:42.008661 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:42.008317    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Jul 14 20:09:43.011573 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:43.011544    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:43.012000 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:43.011874    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:09:43.012373 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:09:43.012353    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:10:14.448194 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:14.448160    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:14.548661 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:14.548632    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:38.659713 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:38.659661    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"]
Jul 14 20:10:38.660256 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:38.659943    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m" podUID="affdf040-94f0-4d06-bd0e-90d3f568b126" containerName="maas-api" containerID="cri-o://685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad" gracePeriod=30
Jul 14 20:10:38.694637 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:38.694615    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:38.903650 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:38.903628    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:10:39.032742 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.032634    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/affdf040-94f0-4d06-bd0e-90d3f568b126-openshift-service-ca\") pod \"affdf040-94f0-4d06-bd0e-90d3f568b126\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") "
Jul 14 20:10:39.032742 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.032689    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clmzq\" (UniqueName: \"kubernetes.io/projected/affdf040-94f0-4d06-bd0e-90d3f568b126-kube-api-access-clmzq\") pod \"affdf040-94f0-4d06-bd0e-90d3f568b126\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") "
Jul 14 20:10:39.032978 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.032792    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affdf040-94f0-4d06-bd0e-90d3f568b126-maas-api-tls\") pod \"affdf040-94f0-4d06-bd0e-90d3f568b126\" (UID: \"affdf040-94f0-4d06-bd0e-90d3f568b126\") "
Jul 14 20:10:39.033043 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.033006    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/affdf040-94f0-4d06-bd0e-90d3f568b126-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "affdf040-94f0-4d06-bd0e-90d3f568b126" (UID: "affdf040-94f0-4d06-bd0e-90d3f568b126"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:10:39.034704 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.034673    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/affdf040-94f0-4d06-bd0e-90d3f568b126-kube-api-access-clmzq" (OuterVolumeSpecName: "kube-api-access-clmzq") pod "affdf040-94f0-4d06-bd0e-90d3f568b126" (UID: "affdf040-94f0-4d06-bd0e-90d3f568b126"). InnerVolumeSpecName "kube-api-access-clmzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:10:39.034811 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.034790    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/affdf040-94f0-4d06-bd0e-90d3f568b126-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "affdf040-94f0-4d06-bd0e-90d3f568b126" (UID: "affdf040-94f0-4d06-bd0e-90d3f568b126"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:10:39.133343 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.133309    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/affdf040-94f0-4d06-bd0e-90d3f568b126-openshift-service-ca\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:39.133343 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.133336    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clmzq\" (UniqueName: \"kubernetes.io/projected/affdf040-94f0-4d06-bd0e-90d3f568b126-kube-api-access-clmzq\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:39.133535 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.133350    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/affdf040-94f0-4d06-bd0e-90d3f568b126-maas-api-tls\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:39.159555 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.159526    2569 generic.go:356] "Generic (PLEG): container finished" podID="affdf040-94f0-4d06-bd0e-90d3f568b126" containerID="685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad" exitCode=0
Jul 14 20:10:39.159688 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.159570    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"
Jul 14 20:10:39.159688 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.159618    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m" event={"ID":"affdf040-94f0-4d06-bd0e-90d3f568b126","Type":"ContainerDied","Data":"685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad"}
Jul 14 20:10:39.159688 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.159673    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m" event={"ID":"affdf040-94f0-4d06-bd0e-90d3f568b126","Type":"ContainerDied","Data":"168234b492b1f0155d512ec307564b3a31fd83ed6ba2d154699d7c7b0e23e912"}
Jul 14 20:10:39.159891 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.159720    2569 scope.go:117] "RemoveContainer" containerID="685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad"
Jul 14 20:10:39.168728 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.168690    2569 scope.go:117] "RemoveContainer" containerID="685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad"
Jul 14 20:10:39.168976 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:10:39.168959    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad\": container with ID starting with 685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad not found: ID does not exist" containerID="685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad"
Jul 14 20:10:39.169040 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.168984    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad"} err="failed to get container status \"685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad\": rpc error: code = NotFound desc = could not find container \"685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad\": container with ID starting with 685c56776a174816a699b3365ce1d4c92c2a5a428432e641929f3674509b13ad not found: ID does not exist"
Jul 14 20:10:39.183886 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.183863    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"]
Jul 14 20:10:39.189796 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.189775    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0ac1fa23-7c6b87957d-ccc8m"]
Jul 14 20:10:39.444060 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:39.444034    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="affdf040-94f0-4d06-bd0e-90d3f568b126" path="/var/lib/kubelet/pods/affdf040-94f0-4d06-bd0e-90d3f568b126/volumes"
Jul 14 20:10:43.138658 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:43.138625    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:50.197323 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:50.197283    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:50.304221 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:50.304193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:54.153745 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.153711    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"]
Jul 14 20:10:54.154203 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.153955    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy" containerID="cri-o://6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f" gracePeriod=30
Jul 14 20:10:54.180207 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.180180    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:54.484554 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.484526    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"]
Jul 14 20:10:54.484889 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.484877    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="affdf040-94f0-4d06-bd0e-90d3f568b126" containerName="maas-api"
Jul 14 20:10:54.484956 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.484892    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="affdf040-94f0-4d06-bd0e-90d3f568b126" containerName="maas-api"
Jul 14 20:10:54.484956 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.484953    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="affdf040-94f0-4d06-bd0e-90d3f568b126" containerName="maas-api"
Jul 14 20:10:54.489251 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.489231    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.491530 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.491511    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8983c49d-openshift-default-dockercfg-fz6dg\""
Jul 14 20:10:54.507448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.507425    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"]
Jul 14 20:10:54.541304 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.541277    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:54.663496 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.663460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20be510-31ef-4515-b308-2c940b5140ad-istiod-ca-cert\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.663676 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.663501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-envoy\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.663676 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.663612    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-socket\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.663676 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.663652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-certs\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.663872 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.663676    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20be510-31ef-4515-b308-2c940b5140ad-istio-podinfo\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.663872 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.663726    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-istio-token\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.663872 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.663821    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-credential-socket\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.663872 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.663856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-data\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.664027 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.663890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtpjv\" (UniqueName: \"kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-kube-api-access-wtpjv\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765056 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.764975    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-socket\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765056 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765011    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-certs\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765056 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765027    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20be510-31ef-4515-b308-2c940b5140ad-istio-podinfo\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765326 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765153    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-istio-token\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765326 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765252    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-credential-socket\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765326 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765288    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-data\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765484 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765325    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtpjv\" (UniqueName: \"kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-kube-api-access-wtpjv\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765484 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765391    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-certs\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765484 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765421    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-socket\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765484 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765398    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20be510-31ef-4515-b308-2c940b5140ad-istiod-ca-cert\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765665 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-envoy\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765665 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765557    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-credential-socket\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.765793 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.765729    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-data\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.766142 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.766119    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20be510-31ef-4515-b308-2c940b5140ad-istiod-ca-cert\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.767537 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.767519    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-envoy\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.767690 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.767670    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20be510-31ef-4515-b308-2c940b5140ad-istio-podinfo\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.774970 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.774949    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-istio-token\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.775170 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.775148    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtpjv\" (UniqueName: \"kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-kube-api-access-wtpjv\") pod \"e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") " pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.799623 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.799599    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:54.939055 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.939024    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"]
Jul 14 20:10:54.942489 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:10:54.942463    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20be510_31ef_4515_b308_2c940b5140ad.slice/crio-e55ca5edf247b5d5e7685a65177f9f36af6f1ccd2f0923e6835b6c620476112b WatchSource:0}: Error finding container e55ca5edf247b5d5e7685a65177f9f36af6f1ccd2f0923e6835b6c620476112b: Status 404 returned error can't find the container with id e55ca5edf247b5d5e7685a65177f9f36af6f1ccd2f0923e6835b6c620476112b
Jul 14 20:10:54.944468 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.944433    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:10:54.944558 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.944512    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:10:54.944626 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:54.944558    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:10:55.236637 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:55.236594    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" event={"ID":"d20be510-31ef-4515-b308-2c940b5140ad","Type":"ContainerStarted","Data":"074d337d2a17ba317255675007df83aaf3ba686afeb5ce341a7563a316ec7ac5"}
Jul 14 20:10:55.237030 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:55.236667    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" event={"ID":"d20be510-31ef-4515-b308-2c940b5140ad","Type":"ContainerStarted","Data":"e55ca5edf247b5d5e7685a65177f9f36af6f1ccd2f0923e6835b6c620476112b"}
Jul 14 20:10:55.259145 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:55.259092    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" podStartSLOduration=1.259072583 podStartE2EDuration="1.259072583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:10:55.258083361 +0000 UTC m=+1980.315602937" watchObservedRunningTime="2026-07-14 20:10:55.259072583 +0000 UTC m=+1980.316592124"
Jul 14 20:10:55.734311 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:55.734241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:55.799993 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:55.799925    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:55.804729 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:55.804688    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:55.928117 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:55.928077    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:56.124542 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:56.124504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:56.218735 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:56.218682    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:56.241119 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:56.241100    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:56.241956 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:56.241938    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:10:56.637929 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:56.637898    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:56.739208 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:56.739170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:10:58.014936 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:58.014900    2569 patch_prober.go:28] interesting pod/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:10:58.015287 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:58.014957    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:10:59.400148 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.400122    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:10:59.503752 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.503726    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-podinfo\") pod \"93671f9f-63a9-4eae-ad12-789868d7c40b\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") "
Jul 14 20:10:59.503870 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.503761    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-socket\") pod \"93671f9f-63a9-4eae-ad12-789868d7c40b\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") "
Jul 14 20:10:59.503870 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.503800    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-credential-socket\") pod \"93671f9f-63a9-4eae-ad12-789868d7c40b\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") "
Jul 14 20:10:59.503870 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.503822    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-envoy\") pod \"93671f9f-63a9-4eae-ad12-789868d7c40b\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") "
Jul 14 20:10:59.504016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.503870    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93671f9f-63a9-4eae-ad12-789868d7c40b-istiod-ca-cert\") pod \"93671f9f-63a9-4eae-ad12-789868d7c40b\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") "
Jul 14 20:10:59.504016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.503907    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-certs\") pod \"93671f9f-63a9-4eae-ad12-789868d7c40b\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") "
Jul 14 20:10:59.504016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.503934    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-token\") pod \"93671f9f-63a9-4eae-ad12-789868d7c40b\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") "
Jul 14 20:10:59.504147 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.504103    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-data\") pod \"93671f9f-63a9-4eae-ad12-789868d7c40b\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") "
Jul 14 20:10:59.504147 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.504126    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93671f9f-63a9-4eae-ad12-789868d7c40b" (UID: "93671f9f-63a9-4eae-ad12-789868d7c40b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:10:59.504236 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.504156    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw6rk\" (UniqueName: \"kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-kube-api-access-tw6rk\") pod \"93671f9f-63a9-4eae-ad12-789868d7c40b\" (UID: \"93671f9f-63a9-4eae-ad12-789868d7c40b\") "
Jul 14 20:10:59.504436 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.504342    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93671f9f-63a9-4eae-ad12-789868d7c40b" (UID: "93671f9f-63a9-4eae-ad12-789868d7c40b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:10:59.504525 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.504488    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93671f9f-63a9-4eae-ad12-789868d7c40b" (UID: "93671f9f-63a9-4eae-ad12-789868d7c40b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:10:59.504525 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.504515    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:59.504639 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.504530    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:59.505221 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.505194    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93671f9f-63a9-4eae-ad12-789868d7c40b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93671f9f-63a9-4eae-ad12-789868d7c40b" (UID: "93671f9f-63a9-4eae-ad12-789868d7c40b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:10:59.505494 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.505474    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-data" (OuterVolumeSpecName: "istio-data") pod "93671f9f-63a9-4eae-ad12-789868d7c40b" (UID: "93671f9f-63a9-4eae-ad12-789868d7c40b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:10:59.505974 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.505951    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93671f9f-63a9-4eae-ad12-789868d7c40b" (UID: "93671f9f-63a9-4eae-ad12-789868d7c40b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:10:59.506389 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.506360    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93671f9f-63a9-4eae-ad12-789868d7c40b" (UID: "93671f9f-63a9-4eae-ad12-789868d7c40b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:10:59.506476 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.506453    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-token" (OuterVolumeSpecName: "istio-token") pod "93671f9f-63a9-4eae-ad12-789868d7c40b" (UID: "93671f9f-63a9-4eae-ad12-789868d7c40b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:10:59.506518 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.506470    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-kube-api-access-tw6rk" (OuterVolumeSpecName: "kube-api-access-tw6rk") pod "93671f9f-63a9-4eae-ad12-789868d7c40b" (UID: "93671f9f-63a9-4eae-ad12-789868d7c40b"). InnerVolumeSpecName "kube-api-access-tw6rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:10:59.605735 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.605688    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:59.605735 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.605729    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:59.605735 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.605738    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93671f9f-63a9-4eae-ad12-789868d7c40b-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:59.605959 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.605745    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:59.605959 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.605754    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:59.605959 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.605761    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93671f9f-63a9-4eae-ad12-789868d7c40b-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:10:59.605959 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:10:59.605768    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw6rk\" (UniqueName: \"kubernetes.io/projected/93671f9f-63a9-4eae-ad12-789868d7c40b-kube-api-access-tw6rk\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:11:00.258661 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.258626    2569 generic.go:356] "Generic (PLEG): container finished" podID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerID="6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f" exitCode=0
Jul 14 20:11:00.258810 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.258669    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" event={"ID":"93671f9f-63a9-4eae-ad12-789868d7c40b","Type":"ContainerDied","Data":"6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f"}
Jul 14 20:11:00.258810 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.258680    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"
Jul 14 20:11:00.258810 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.258728    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp" event={"ID":"93671f9f-63a9-4eae-ad12-789868d7c40b","Type":"ContainerDied","Data":"c25901ccb43632c388a7020d097f5623405ce3255b3d23d179208a4fbf3b0f54"}
Jul 14 20:11:00.258810 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.258750    2569 scope.go:117] "RemoveContainer" containerID="6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f"
Jul 14 20:11:00.272681 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.272534    2569 scope.go:117] "RemoveContainer" containerID="5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82"
Jul 14 20:11:00.281582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.281559    2569 scope.go:117] "RemoveContainer" containerID="6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f"
Jul 14 20:11:00.281854 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:11:00.281831    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f\": container with ID starting with 6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f not found: ID does not exist" containerID="6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f"
Jul 14 20:11:00.281928 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.281861    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f"} err="failed to get container status \"6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f\": rpc error: code = NotFound desc = could not find container \"6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f\": container with ID starting with 6532d24c99da5d79fba7dcb2a98996e47eb9236fe2ba1d4018a4d068660e9c8f not found: ID does not exist"
Jul 14 20:11:00.281928 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.281878    2569 scope.go:117] "RemoveContainer" containerID="5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82"
Jul 14 20:11:00.282173 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:11:00.282157    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82\": container with ID starting with 5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82 not found: ID does not exist" containerID="5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82"
Jul 14 20:11:00.282233 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.282176    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82"} err="failed to get container status \"5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82\": rpc error: code = NotFound desc = could not find container \"5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82\": container with ID starting with 5c6d36a82b1d1edd984a043b58feefc2820c875b24bfe43d4bfccbd731fb4e82 not found: ID does not exist"
Jul 14 20:11:00.291832 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.291813    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"]
Jul 14 20:11:00.295592 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:00.295561    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0ac1fa23-openshift-default-7f498cdcfc-4snwp"]
Jul 14 20:11:01.444478 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:01.444435    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" path="/var/lib/kubelet/pods/93671f9f-63a9-4eae-ad12-789868d7c40b/volumes"
Jul 14 20:11:06.419134 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:06.419061    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:11:06.538056 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:06.538016    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:11:10.010103 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:10.010066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:11:11.242549 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:11.242521    2569 patch_prober.go:28] interesting pod/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 14 20:11:11.242867 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:11.242582    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 14 20:11:11.311303 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:11.311278    2569 generic.go:356] "Generic (PLEG): container finished" podID="d20be510-31ef-4515-b308-2c940b5140ad" containerID="074d337d2a17ba317255675007df83aaf3ba686afeb5ce341a7563a316ec7ac5" exitCode=0
Jul 14 20:11:11.311402 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:11.311357    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" event={"ID":"d20be510-31ef-4515-b308-2c940b5140ad","Type":"ContainerDied","Data":"074d337d2a17ba317255675007df83aaf3ba686afeb5ce341a7563a316ec7ac5"}
Jul 14 20:11:11.311725 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:11.311687    2569 scope.go:117] "RemoveContainer" containerID="074d337d2a17ba317255675007df83aaf3ba686afeb5ce341a7563a316ec7ac5"
Jul 14 20:11:11.312652 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:11.312624    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:11:11.312725 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:11.312688    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:11:11.312772 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:11.312758    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:11:12.317285 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:12.317249    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" event={"ID":"d20be510-31ef-4515-b308-2c940b5140ad","Type":"ContainerStarted","Data":"269dc7f15956ba823c6fa9e9e99f6c09e40ebca44b0c60af7bf8288799b2ccd9"}
Jul 14 20:11:12.800247 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:12.800213    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:11:12.800421 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:12.800376    2569 patch_prober.go:28] interesting pod/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 14 20:11:12.800478 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:12.800434    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 14 20:11:13.800593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:13.800559    2569 patch_prober.go:28] interesting pod/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 14 20:11:13.800993 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:13.800625    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 14 20:11:14.800225 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:14.800187    2569 patch_prober.go:28] interesting pod/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 14 20:11:14.800405 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:14.800254    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 14 20:11:15.800957 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:15.800914    2569 patch_prober.go:28] interesting pod/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 14 20:11:15.801343 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:15.800973    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 14 20:11:16.695831 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:16.695796    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:11:16.800322 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:16.800285    2569 patch_prober.go:28] interesting pod/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 14 20:11:16.800484 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:16.800339    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 14 20:11:17.804015 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:17.803986    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:11:17.804475 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:17.804287    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:11:17.805099 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:17.805078    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:11:38.229511 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:38.229469    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:11:39.575828 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:11:39.575799    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:00.702304 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:00.702259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:05.179642 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:05.179607    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:05.342476 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:05.342410    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:11.358748 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:11.358711    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:11.474929 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:11.474892    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:15.360161 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:15.360131    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"]
Jul 14 20:12:15.360553 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:15.360339    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy" containerID="cri-o://269dc7f15956ba823c6fa9e9e99f6c09e40ebca44b0c60af7bf8288799b2ccd9" gracePeriod=30
Jul 14 20:12:15.387143 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:15.387118    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:15.995305 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:15.995273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:16.098758 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:16.098727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:16.192907 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:16.192879    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:17.668049 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:17.667968    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:17.806328 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:17.806289    2569 patch_prober.go:28] interesting pod/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:12:17.806479 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:17.806347    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:12:20.602952 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.602924    2569 generic.go:356] "Generic (PLEG): container finished" podID="d20be510-31ef-4515-b308-2c940b5140ad" containerID="269dc7f15956ba823c6fa9e9e99f6c09e40ebca44b0c60af7bf8288799b2ccd9" exitCode=0
Jul 14 20:12:20.603275 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.602966    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" event={"ID":"d20be510-31ef-4515-b308-2c940b5140ad","Type":"ContainerDied","Data":"269dc7f15956ba823c6fa9e9e99f6c09e40ebca44b0c60af7bf8288799b2ccd9"}
Jul 14 20:12:20.603275 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.603028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt" event={"ID":"d20be510-31ef-4515-b308-2c940b5140ad","Type":"ContainerDied","Data":"e55ca5edf247b5d5e7685a65177f9f36af6f1ccd2f0923e6835b6c620476112b"}
Jul 14 20:12:20.603275 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.603045    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e55ca5edf247b5d5e7685a65177f9f36af6f1ccd2f0923e6835b6c620476112b"
Jul 14 20:12:20.603275 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.603059    2569 scope.go:117] "RemoveContainer" containerID="074d337d2a17ba317255675007df83aaf3ba686afeb5ce341a7563a316ec7ac5"
Jul 14 20:12:20.609580 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.609556    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:12:20.687046 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687016    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20be510-31ef-4515-b308-2c940b5140ad-istio-podinfo\") pod \"d20be510-31ef-4515-b308-2c940b5140ad\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") "
Jul 14 20:12:20.687194 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687077    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtpjv\" (UniqueName: \"kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-kube-api-access-wtpjv\") pod \"d20be510-31ef-4515-b308-2c940b5140ad\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") "
Jul 14 20:12:20.687194 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687117    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20be510-31ef-4515-b308-2c940b5140ad-istiod-ca-cert\") pod \"d20be510-31ef-4515-b308-2c940b5140ad\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") "
Jul 14 20:12:20.687319 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687298    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-envoy\") pod \"d20be510-31ef-4515-b308-2c940b5140ad\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") "
Jul 14 20:12:20.687385 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687363    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-certs\") pod \"d20be510-31ef-4515-b308-2c940b5140ad\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") "
Jul 14 20:12:20.687442 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687402    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-socket\") pod \"d20be510-31ef-4515-b308-2c940b5140ad\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") "
Jul 14 20:12:20.687500 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687451    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-credential-socket\") pod \"d20be510-31ef-4515-b308-2c940b5140ad\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") "
Jul 14 20:12:20.687500 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687484    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-data\") pod \"d20be510-31ef-4515-b308-2c940b5140ad\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") "
Jul 14 20:12:20.687613 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687541    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-istio-token\") pod \"d20be510-31ef-4515-b308-2c940b5140ad\" (UID: \"d20be510-31ef-4515-b308-2c940b5140ad\") "
Jul 14 20:12:20.687768 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687476    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d20be510-31ef-4515-b308-2c940b5140ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d20be510-31ef-4515-b308-2c940b5140ad" (UID: "d20be510-31ef-4515-b308-2c940b5140ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:12:20.687768 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687729    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d20be510-31ef-4515-b308-2c940b5140ad" (UID: "d20be510-31ef-4515-b308-2c940b5140ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:12:20.687902 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.687851    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d20be510-31ef-4515-b308-2c940b5140ad" (UID: "d20be510-31ef-4515-b308-2c940b5140ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:12:20.688095 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.688057    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d20be510-31ef-4515-b308-2c940b5140ad" (UID: "d20be510-31ef-4515-b308-2c940b5140ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:12:20.688506 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.688487    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d20be510-31ef-4515-b308-2c940b5140ad-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:12:20.688652 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.688638    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:12:20.688817 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.688795    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:12:20.688817 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.688818    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:12:20.688983 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.688862    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "d20be510-31ef-4515-b308-2c940b5140ad" (UID: "d20be510-31ef-4515-b308-2c940b5140ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:12:20.689731 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.689668    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d20be510-31ef-4515-b308-2c940b5140ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d20be510-31ef-4515-b308-2c940b5140ad" (UID: "d20be510-31ef-4515-b308-2c940b5140ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:12:20.690391 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.689827    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d20be510-31ef-4515-b308-2c940b5140ad" (UID: "d20be510-31ef-4515-b308-2c940b5140ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:12:20.690391 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.689890    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-kube-api-access-wtpjv" (OuterVolumeSpecName: "kube-api-access-wtpjv") pod "d20be510-31ef-4515-b308-2c940b5140ad" (UID: "d20be510-31ef-4515-b308-2c940b5140ad"). InnerVolumeSpecName "kube-api-access-wtpjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:12:20.690391 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.690038    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "d20be510-31ef-4515-b308-2c940b5140ad" (UID: "d20be510-31ef-4515-b308-2c940b5140ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:12:20.789485 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.789463    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d20be510-31ef-4515-b308-2c940b5140ad-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:12:20.789579 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.789485    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtpjv\" (UniqueName: \"kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-kube-api-access-wtpjv\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:12:20.789579 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.789498    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:12:20.789579 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.789506    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d20be510-31ef-4515-b308-2c940b5140ad-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:12:20.789579 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:20.789513    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d20be510-31ef-4515-b308-2c940b5140ad-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:12:21.608894 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:21.608867    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"
Jul 14 20:12:21.651407 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:21.651378    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"]
Jul 14 20:12:21.655175 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:21.655152    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8983c49d-openshift-default-676db44ddc-5p4jt"]
Jul 14 20:12:21.870201 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:21.870166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:23.444092 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:23.444061    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d20be510-31ef-4515-b308-2c940b5140ad" path="/var/lib/kubelet/pods/d20be510-31ef-4515-b308-2c940b5140ad/volumes"
Jul 14 20:12:23.922392 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:23.922363    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:24.029193 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:24.029161    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:24.122919 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:24.122884    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:24.223184 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:24.223067    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:24.627487 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:24.627450    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:50.649028 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:50.648995    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:55.513356 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:55.513327    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:12:55.515517 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:55.515493    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:12:56.821957 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:56.821918    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:56.963253 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:56.963211    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:12:57.063368 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:12:57.063337    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:12.895504 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:12.895448    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:18.946565 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:18.946535    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:19.054438 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:19.054406    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:19.152869 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:19.152838    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:29.736766 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:29.736727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:30.534449 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:30.534419    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:36.639879 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:36.639847    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:36.725444 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:36.725415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:36.818618 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:36.818589    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:36.918975 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:36.918894    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:37.727076 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:37.727032    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:37.830156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:37.830125    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:38.098121 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:38.098045    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:39.610142 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:39.610112    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:45.732096 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:45.732060    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:45.817704 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:45.817665    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:46.432473 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:46.432438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:52.749303 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:52.749267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:52.895381 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:52.895349    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:52.994958 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:52.994931    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:53.293254 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293212    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"]
Jul 14 20:13:53.293565 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293552    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy"
Jul 14 20:13:53.293620 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293566    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy"
Jul 14 20:13:53.293620 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293575    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy"
Jul 14 20:13:53.293620 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293581    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy"
Jul 14 20:13:53.293620 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293598    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy"
Jul 14 20:13:53.293620 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293603    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy"
Jul 14 20:13:53.293620 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293611    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy"
Jul 14 20:13:53.293620 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293616    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy"
Jul 14 20:13:53.293888 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293662    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy"
Jul 14 20:13:53.293888 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293673    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy"
Jul 14 20:13:53.293888 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.293681    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="93671f9f-63a9-4eae-ad12-789868d7c40b" containerName="istio-proxy"
Jul 14 20:13:53.296447 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.296431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.299197 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.299176    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-43646543-openshift-default-dockercfg-v5cdr\""
Jul 14 20:13:53.319475 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.319449    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"]
Jul 14 20:13:53.324843 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.324819    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:53.342829 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.342806    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-certs\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.342920 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.342851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-credential-socket\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.342920 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.342871    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-data\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.342920 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.342916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-socket\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.343038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.342941    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istiod-ca-cert\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.343038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.342964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqxr8\" (UniqueName: \"kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-kube-api-access-vqxr8\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.343038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.342986    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-token\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.343038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.343028    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-podinfo\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.343196 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.343091    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-envoy\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444048 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444018    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-certs\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444217 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444067    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-credential-socket\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444217 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444092    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-data\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444217 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-socket\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444217 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444192    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istiod-ca-cert\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444431 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444231    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqxr8\" (UniqueName: \"kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-kube-api-access-vqxr8\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444431 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444262    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-token\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444431 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444288    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-podinfo\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444431 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444318    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-envoy\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444645 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444484    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-data\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444645 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444526    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-socket\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444861 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444837    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-certs\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.444929 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.444843    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-credential-socket\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.445026 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.445005    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istiod-ca-cert\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.446549 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.446529    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-envoy\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.446775 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.446758    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-podinfo\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.454496 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.454477    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-token\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.454718 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.454675    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqxr8\" (UniqueName: \"kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-kube-api-access-vqxr8\") pod \"e2e-mt-43646543-openshift-default-7bd47564c9-glnk2\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") " pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.606219 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.606140    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:53.711372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.711339    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:53.740518 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.740495    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"]
Jul 14 20:13:53.741933 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:13:53.741907    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ee7fc6_d05c_49ec_b8a2_8b9b4035d427.slice/crio-8316f68b4eaf6a1e326bb9768b4d5c5a37d3bb4492076d4bfce4ea4d20e4579a WatchSource:0}: Error finding container 8316f68b4eaf6a1e326bb9768b4d5c5a37d3bb4492076d4bfce4ea4d20e4579a: Status 404 returned error can't find the container with id 8316f68b4eaf6a1e326bb9768b4d5c5a37d3bb4492076d4bfce4ea4d20e4579a
Jul 14 20:13:53.749961 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.749898    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:13:53.750258 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.749996    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:13:53.750258 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:53.750029    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:13:54.000769 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:54.000727    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" event={"ID":"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427","Type":"ContainerStarted","Data":"3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948"}
Jul 14 20:13:54.000961 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:54.000815    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" event={"ID":"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427","Type":"ContainerStarted","Data":"8316f68b4eaf6a1e326bb9768b4d5c5a37d3bb4492076d4bfce4ea4d20e4579a"}
Jul 14 20:13:54.021721 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:54.021652    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" podStartSLOduration=1.021635777 podStartE2EDuration="1.021635777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:13:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:13:54.02035241 +0000 UTC m=+2159.077871950" watchObservedRunningTime="2026-07-14 20:13:54.021635777 +0000 UTC m=+2159.079155317"
Jul 14 20:13:54.606802 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:54.606771    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:54.611740 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:54.611715    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:55.005410 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:55.005375    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:55.006201 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:55.006182    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:13:56.209888 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.209856    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:56.297083 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.297054    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:56.301581 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.301554    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"]
Jul 14 20:13:56.301952 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.301939    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d20be510-31ef-4515-b308-2c940b5140ad" containerName="istio-proxy"
Jul 14 20:13:56.305066 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.305045    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:56.307708 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.307673    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfc6h\""
Jul 14 20:13:56.307838 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.307821    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-43646543-serving-cert\""
Jul 14 20:13:56.319865 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.319817    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"]
Jul 14 20:13:56.370464 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.370437    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:56.372638 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.372617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c75473-1960-4817-b6ae-b927f901fb36-openshift-service-ca\") pod \"maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:56.372748 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.372675    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14c75473-1960-4817-b6ae-b927f901fb36-maas-api-tls\") pod \"maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:56.372748 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.372722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4f9m\" (UniqueName: \"kubernetes.io/projected/14c75473-1960-4817-b6ae-b927f901fb36-kube-api-access-b4f9m\") pod \"maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:56.473633 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.473553    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c75473-1960-4817-b6ae-b927f901fb36-openshift-service-ca\") pod \"maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:56.473633 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.473602    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14c75473-1960-4817-b6ae-b927f901fb36-maas-api-tls\") pod \"maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:56.473846 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:13:56.473728    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-43646543-serving-cert: secret "maas-api-e2e-mt-43646543-serving-cert" not found
Jul 14 20:13:56.473846 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.473735    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4f9m\" (UniqueName: \"kubernetes.io/projected/14c75473-1960-4817-b6ae-b927f901fb36-kube-api-access-b4f9m\") pod \"maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:56.473846 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:13:56.473777    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c75473-1960-4817-b6ae-b927f901fb36-maas-api-tls podName:14c75473-1960-4817-b6ae-b927f901fb36 nodeName:}" failed. No retries permitted until 2026-07-14 20:13:56.973761964 +0000 UTC m=+2162.031281482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/14c75473-1960-4817-b6ae-b927f901fb36-maas-api-tls") pod "maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8" (UID: "14c75473-1960-4817-b6ae-b927f901fb36") : secret "maas-api-e2e-mt-43646543-serving-cert" not found
Jul 14 20:13:56.474213 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.474196    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c75473-1960-4817-b6ae-b927f901fb36-openshift-service-ca\") pod \"maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:56.482547 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.482520    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4f9m\" (UniqueName: \"kubernetes.io/projected/14c75473-1960-4817-b6ae-b927f901fb36-kube-api-access-b4f9m\") pod \"maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:56.578253 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.578217    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:56.978739 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.978682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14c75473-1960-4817-b6ae-b927f901fb36-maas-api-tls\") pod \"maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:56.981018 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:56.980994    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14c75473-1960-4817-b6ae-b927f901fb36-maas-api-tls\") pod \"maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:57.052135 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:57.052096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:57.190156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:57.190124    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:13:57.215127 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:57.215100    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:57.353043 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:57.353013    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"]
Jul 14 20:13:57.354283 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:13:57.354256    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c75473_1960_4817_b6ae_b927f901fb36.slice/crio-f5eaa331d9aadbc47c4ede1b2fdc9b51c98be2f17d9bb2a4849d3bed58306aa2 WatchSource:0}: Error finding container f5eaa331d9aadbc47c4ede1b2fdc9b51c98be2f17d9bb2a4849d3bed58306aa2: Status 404 returned error can't find the container with id f5eaa331d9aadbc47c4ede1b2fdc9b51c98be2f17d9bb2a4849d3bed58306aa2
Jul 14 20:13:57.355744 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:57.355725    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:13:58.017769 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:58.017737    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8" event={"ID":"14c75473-1960-4817-b6ae-b927f901fb36","Type":"ContainerStarted","Data":"693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10"}
Jul 14 20:13:58.017910 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:58.017798    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8" event={"ID":"14c75473-1960-4817-b6ae-b927f901fb36","Type":"ContainerStarted","Data":"f5eaa331d9aadbc47c4ede1b2fdc9b51c98be2f17d9bb2a4849d3bed58306aa2"}
Jul 14 20:13:58.017910 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:58.017827    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:13:58.036943 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:13:58.036878    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8" podStartSLOduration=1.501196204 podStartE2EDuration="2.036858395s" totalImagesPullingTime="535.662191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:13:58.034116586 +0000 UTC m=+2163.091636126" watchObservedRunningTime="2026-07-14 20:13:58.036858395 +0000 UTC m=+2163.094377936"
Jul 14 20:14:00.619059 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:00.619027    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:01.335013 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:01.334977    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:02.425380 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:02.425350    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:02.523520 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:02.523490    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:04.038734 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:04.038676    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:14:08.091775 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:08.091737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:08.188766 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:08.188733    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:10.007117 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:10.007080    2569 patch_prober.go:28] interesting pod/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 14 20:14:10.007517 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:10.007147    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 14 20:14:10.077680 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:10.077647    2569 generic.go:356] "Generic (PLEG): container finished" podID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerID="3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948" exitCode=0
Jul 14 20:14:10.077865 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:10.077737    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" event={"ID":"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427","Type":"ContainerDied","Data":"3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948"}
Jul 14 20:14:10.078156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:10.078142    2569 scope.go:117] "RemoveContainer" containerID="3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948"
Jul 14 20:14:10.079143 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:10.079112    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:14:10.079202 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:10.079185    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:14:10.079234 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:10.079217    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:14:11.084415 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:11.084384    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" event={"ID":"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427","Type":"ContainerStarted","Data":"8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33"}
Jul 14 20:14:11.606547 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:11.606508    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:14:11.606804 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:11.606775    2569 patch_prober.go:28] interesting pod/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 14 20:14:11.606902 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:11.606838    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 14 20:14:12.606666 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:12.606632    2569 patch_prober.go:28] interesting pod/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 14 20:14:12.607038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:12.606682    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 14 20:14:13.606751 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:13.606688    2569 patch_prober.go:28] interesting pod/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 14 20:14:13.607131 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:13.606771    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 14 20:14:14.607316 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:14.607278    2569 patch_prober.go:28] interesting pod/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Jul 14 20:14:14.607721 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:14.607347    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Jul 14 20:14:15.347160 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:15.347127    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:15.447874 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:15.447845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:15.611070 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:15.610984    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:14:15.611461 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:15.611284    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:14:15.612057 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:15.612038    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:14:19.032730 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.032678    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:19.135089 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.135051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:19.327141 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.327051    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"]
Jul 14 20:14:19.327304 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.327261    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8" podUID="14c75473-1960-4817-b6ae-b927f901fb36" containerName="maas-api" containerID="cri-o://693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10" gracePeriod=30
Jul 14 20:14:19.357805 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.357777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:19.575585 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.575563    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:14:19.695527 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.695497    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4f9m\" (UniqueName: \"kubernetes.io/projected/14c75473-1960-4817-b6ae-b927f901fb36-kube-api-access-b4f9m\") pod \"14c75473-1960-4817-b6ae-b927f901fb36\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") "
Jul 14 20:14:19.695688 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.695571    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14c75473-1960-4817-b6ae-b927f901fb36-maas-api-tls\") pod \"14c75473-1960-4817-b6ae-b927f901fb36\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") "
Jul 14 20:14:19.695688 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.695648    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c75473-1960-4817-b6ae-b927f901fb36-openshift-service-ca\") pod \"14c75473-1960-4817-b6ae-b927f901fb36\" (UID: \"14c75473-1960-4817-b6ae-b927f901fb36\") "
Jul 14 20:14:19.695992 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.695969    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14c75473-1960-4817-b6ae-b927f901fb36-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "14c75473-1960-4817-b6ae-b927f901fb36" (UID: "14c75473-1960-4817-b6ae-b927f901fb36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:14:19.697667 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.697646    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14c75473-1960-4817-b6ae-b927f901fb36-kube-api-access-b4f9m" (OuterVolumeSpecName: "kube-api-access-b4f9m") pod "14c75473-1960-4817-b6ae-b927f901fb36" (UID: "14c75473-1960-4817-b6ae-b927f901fb36"). InnerVolumeSpecName "kube-api-access-b4f9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:14:19.697667 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.697647    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14c75473-1960-4817-b6ae-b927f901fb36-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "14c75473-1960-4817-b6ae-b927f901fb36" (UID: "14c75473-1960-4817-b6ae-b927f901fb36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:14:19.796558 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.796523    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14c75473-1960-4817-b6ae-b927f901fb36-openshift-service-ca\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:19.796558 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.796552    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4f9m\" (UniqueName: \"kubernetes.io/projected/14c75473-1960-4817-b6ae-b927f901fb36-kube-api-access-b4f9m\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:19.796558 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:19.796562    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14c75473-1960-4817-b6ae-b927f901fb36-maas-api-tls\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:20.124293 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:20.124265    2569 generic.go:356] "Generic (PLEG): container finished" podID="14c75473-1960-4817-b6ae-b927f901fb36" containerID="693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10" exitCode=0
Jul 14 20:14:20.124774 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:20.124309    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"
Jul 14 20:14:20.124774 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:20.124355    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8" event={"ID":"14c75473-1960-4817-b6ae-b927f901fb36","Type":"ContainerDied","Data":"693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10"}
Jul 14 20:14:20.124774 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:20.124418    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8" event={"ID":"14c75473-1960-4817-b6ae-b927f901fb36","Type":"ContainerDied","Data":"f5eaa331d9aadbc47c4ede1b2fdc9b51c98be2f17d9bb2a4849d3bed58306aa2"}
Jul 14 20:14:20.124774 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:20.124455    2569 scope.go:117] "RemoveContainer" containerID="693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10"
Jul 14 20:14:20.132735 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:20.132720    2569 scope.go:117] "RemoveContainer" containerID="693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10"
Jul 14 20:14:20.133009 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:14:20.132985    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10\": container with ID starting with 693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10 not found: ID does not exist" containerID="693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10"
Jul 14 20:14:20.133054 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:20.133016    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10"} err="failed to get container status \"693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10\": rpc error: code = NotFound desc = could not find container \"693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10\": container with ID starting with 693b9f538d82fa6f757ab560cfee8eb2444b9401cecd74ecacd6b7db9fcb4c10 not found: ID does not exist"
Jul 14 20:14:20.151724 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:20.147425    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"]
Jul 14 20:14:20.153715 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:20.153680    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-43646543-67b5db6fcc-tn4s8"]
Jul 14 20:14:21.444903 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:21.444869    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14c75473-1960-4817-b6ae-b927f901fb36" path="/var/lib/kubelet/pods/14c75473-1960-4817-b6ae-b927f901fb36/volumes"
Jul 14 20:14:23.548680 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:23.548633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:30.044095 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:30.044061    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:30.145305 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:30.145267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:34.233801 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:34.233768    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"]
Jul 14 20:14:34.234245 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:34.234021    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy" containerID="cri-o://8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33" gracePeriod=30
Jul 14 20:14:34.260685 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:34.260658    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:34.544099 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:34.544002    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:34.646589 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:34.646559    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:34.747114 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:34.747081    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:34.880263 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:34.880238    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:39.477636 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.477612    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:14:39.552593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.552526    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-envoy\") pod \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") "
Jul 14 20:14:39.552593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.552561    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-certs\") pod \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") "
Jul 14 20:14:39.552593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.552579    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-data\") pod \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") "
Jul 14 20:14:39.552887 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.552600    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-podinfo\") pod \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") "
Jul 14 20:14:39.552887 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.552630    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istiod-ca-cert\") pod \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") "
Jul 14 20:14:39.552887 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.552654    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqxr8\" (UniqueName: \"kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-kube-api-access-vqxr8\") pod \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") "
Jul 14 20:14:39.552887 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.552672    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-token\") pod \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") "
Jul 14 20:14:39.552887 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.552742    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-socket\") pod \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") "
Jul 14 20:14:39.552887 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.552774    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-credential-socket\") pod \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\" (UID: \"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427\") "
Jul 14 20:14:39.552887 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.552869    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" (UID: "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:14:39.553249 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.553027    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:39.553249 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.553086    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" (UID: "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:14:39.553249 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.553138    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" (UID: "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:14:39.553249 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.553177    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" (UID: "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:14:39.553516 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.553496    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-data" (OuterVolumeSpecName: "istio-data") pod "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" (UID: "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:14:39.554951 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.554926    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" (UID: "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:14:39.555094 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.555071    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-kube-api-access-vqxr8" (OuterVolumeSpecName: "kube-api-access-vqxr8") pod "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" (UID: "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427"). InnerVolumeSpecName "kube-api-access-vqxr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:14:39.555138 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.555097    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-token" (OuterVolumeSpecName: "istio-token") pod "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" (UID: "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:14:39.555193 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.555179    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" (UID: "40ee7fc6-d05c-49ec-b8a2-8b9b4035d427"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:14:39.653937 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.653905    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:39.653937 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.653932    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:39.653937 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.653940    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:39.654151 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.653950    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:39.654151 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.653958    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:39.654151 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.653967    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:39.654151 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.653975    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:39.654151 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:39.653982    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqxr8\" (UniqueName: \"kubernetes.io/projected/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427-kube-api-access-vqxr8\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:14:40.211142 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.211105    2569 generic.go:356] "Generic (PLEG): container finished" podID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerID="8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33" exitCode=0
Jul 14 20:14:40.211306 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.211150    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" event={"ID":"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427","Type":"ContainerDied","Data":"8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33"}
Jul 14 20:14:40.211306 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.211160    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"
Jul 14 20:14:40.211306 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.211238    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2" event={"ID":"40ee7fc6-d05c-49ec-b8a2-8b9b4035d427","Type":"ContainerDied","Data":"8316f68b4eaf6a1e326bb9768b4d5c5a37d3bb4492076d4bfce4ea4d20e4579a"}
Jul 14 20:14:40.211306 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.211271    2569 scope.go:117] "RemoveContainer" containerID="8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33"
Jul 14 20:14:40.220257 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.220240    2569 scope.go:117] "RemoveContainer" containerID="3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948"
Jul 14 20:14:40.228028 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.228009    2569 scope.go:117] "RemoveContainer" containerID="8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33"
Jul 14 20:14:40.228302 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:14:40.228281    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33\": container with ID starting with 8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33 not found: ID does not exist" containerID="8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33"
Jul 14 20:14:40.228363 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.228311    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33"} err="failed to get container status \"8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33\": rpc error: code = NotFound desc = could not find container \"8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33\": container with ID starting with 8952cb4f60e42e1e512da43f34819fdc1864ff606cb638a1703712058a7d8e33 not found: ID does not exist"
Jul 14 20:14:40.228363 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.228337    2569 scope.go:117] "RemoveContainer" containerID="3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948"
Jul 14 20:14:40.228608 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:14:40.228588    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948\": container with ID starting with 3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948 not found: ID does not exist" containerID="3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948"
Jul 14 20:14:40.228669 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.228613    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948"} err="failed to get container status \"3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948\": rpc error: code = NotFound desc = could not find container \"3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948\": container with ID starting with 3bdac1c8190fa03b13ceba5f7e3c2c5ac87f7f695a0e981bd07d638cea5cb948 not found: ID does not exist"
Jul 14 20:14:40.257927 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.257898    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"]
Jul 14 20:14:40.268274 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:40.268256    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-43646543-openshift-default-7bd47564c9-glnk2"]
Jul 14 20:14:41.170749 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:41.170714    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:41.253212 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:41.253186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:41.445286 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:41.445207    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" path="/var/lib/kubelet/pods/40ee7fc6-d05c-49ec-b8a2-8b9b4035d427/volumes"
Jul 14 20:14:41.498944 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:41.498921    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:41.594271 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:41.594245    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:47.477125 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:47.477090    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:47.539224 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:47.539193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:54.421359 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.421330    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:54.690040 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.689960    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"]
Jul 14 20:14:54.690497 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.690474    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy"
Jul 14 20:14:54.690671 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.690652    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy"
Jul 14 20:14:54.690808 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.690682    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy"
Jul 14 20:14:54.690808 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.690708    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy"
Jul 14 20:14:54.690808 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.690722    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14c75473-1960-4817-b6ae-b927f901fb36" containerName="maas-api"
Jul 14 20:14:54.690808 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.690730    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="14c75473-1960-4817-b6ae-b927f901fb36" containerName="maas-api"
Jul 14 20:14:54.691023 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.690901    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="14c75473-1960-4817-b6ae-b927f901fb36" containerName="maas-api"
Jul 14 20:14:54.691023 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.690915    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy"
Jul 14 20:14:54.691023 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.690923    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ee7fc6-d05c-49ec-b8a2-8b9b4035d427" containerName="istio-proxy"
Jul 14 20:14:54.694088 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.694071    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.696527 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.696510    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6023fdbc-openshift-default-dockercfg-554km\""
Jul 14 20:14:54.706126 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.706104    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"]
Jul 14 20:14:54.717514 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.717493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:54.775854 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.775812    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-envoy\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.776027 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.775895    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-credential-socket\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.776027 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.775928    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-certs\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.776027 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.775967    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-data\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.776027 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.776001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-token\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.776226 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.776052    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-socket\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.776226 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.776078    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkbd5\" (UniqueName: \"kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-kube-api-access-lkbd5\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.776226 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.776113    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-podinfo\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.776226 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.776154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istiod-ca-cert\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877110 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877063    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-socket\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877110 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877112    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkbd5\" (UniqueName: \"kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-kube-api-access-lkbd5\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-podinfo\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istiod-ca-cert\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877185    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-envoy\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877216    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-credential-socket\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877240    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-certs\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877281    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-data\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877304    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-token\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877686 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877546    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-socket\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877686 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877598    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-certs\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877806 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877752    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-data\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.877806 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.877758    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-credential-socket\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.878228 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.878200    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istiod-ca-cert\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.879558 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.879538    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-envoy\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.879804 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.879786    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-podinfo\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.886379 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.886354    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-token\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:54.886551 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:54.886532    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkbd5\" (UniqueName: \"kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-kube-api-access-lkbd5\") pod \"e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") " pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:55.004469 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:55.004374    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:55.164992 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:55.164968    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"]
Jul 14 20:14:55.166504 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:14:55.166477    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d4eb1e_b76c_4d42_a11e_f5dd7cc6ec82.slice/crio-e3b4575e0b8d8c88cb9b8dfe05908f878bfb162dec58654c7323a42252557666 WatchSource:0}: Error finding container e3b4575e0b8d8c88cb9b8dfe05908f878bfb162dec58654c7323a42252557666: Status 404 returned error can't find the container with id e3b4575e0b8d8c88cb9b8dfe05908f878bfb162dec58654c7323a42252557666
Jul 14 20:14:55.168472 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:55.168439    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:14:55.168538 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:55.168507    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:14:55.168575 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:55.168536    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:14:55.277919 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:55.277809    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" event={"ID":"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82","Type":"ContainerStarted","Data":"3a9b931a1f68de0588100125f5e3c2f8da1d44414c9780f348b4df9b6e66e1ca"}
Jul 14 20:14:55.277919 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:55.277878    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" event={"ID":"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82","Type":"ContainerStarted","Data":"e3b4575e0b8d8c88cb9b8dfe05908f878bfb162dec58654c7323a42252557666"}
Jul 14 20:14:55.306598 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:55.306534    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" podStartSLOduration=1.30651391 podStartE2EDuration="1.30651391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:14:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:14:55.304051056 +0000 UTC m=+2220.361570597" watchObservedRunningTime="2026-07-14 20:14:55.30651391 +0000 UTC m=+2220.364033447"
Jul 14 20:14:55.455446 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:55.455417    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:56.005459 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:56.005425    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:56.010349 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:56.010324    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:56.282152 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:56.282074    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:56.283016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:56.282989    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:14:57.342873 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.342829    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:57.441607 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.441576    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:57.591456 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.591424    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"]
Jul 14 20:14:57.594565 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.594489    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:57.601126 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.601099    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6023fdbc-serving-cert\""
Jul 14 20:14:57.601249 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.601204    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfc6h\""
Jul 14 20:14:57.606796 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.606773    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"]
Jul 14 20:14:57.639565 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.639539    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:57.702820 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.702783    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80977e30-da50-4216-9d60-06cde57fb761-maas-api-tls\") pod \"maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:57.702979 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.702860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8jj5\" (UniqueName: \"kubernetes.io/projected/80977e30-da50-4216-9d60-06cde57fb761-kube-api-access-n8jj5\") pod \"maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:57.702979 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.702882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80977e30-da50-4216-9d60-06cde57fb761-openshift-service-ca\") pod \"maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:57.754334 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.754298    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:57.803682 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.803645    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80977e30-da50-4216-9d60-06cde57fb761-maas-api-tls\") pod \"maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:57.803856 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.803738    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8jj5\" (UniqueName: \"kubernetes.io/projected/80977e30-da50-4216-9d60-06cde57fb761-kube-api-access-n8jj5\") pod \"maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:57.803856 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.803759    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80977e30-da50-4216-9d60-06cde57fb761-openshift-service-ca\") pod \"maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:57.804425 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.804406    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80977e30-da50-4216-9d60-06cde57fb761-openshift-service-ca\") pod \"maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:57.806013 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.805996    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80977e30-da50-4216-9d60-06cde57fb761-maas-api-tls\") pod \"maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:57.812031 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.812009    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8jj5\" (UniqueName: \"kubernetes.io/projected/80977e30-da50-4216-9d60-06cde57fb761-kube-api-access-n8jj5\") pod \"maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:57.906874 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:57.906837    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:58.054730 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:58.054689    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"]
Jul 14 20:14:58.057226 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:14:58.057200    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80977e30_da50_4216_9d60_06cde57fb761.slice/crio-f0a4f5a281604e80a6806207cc5a8d133490fb2be8ccd3819dc9897dccfb60f8 WatchSource:0}: Error finding container f0a4f5a281604e80a6806207cc5a8d133490fb2be8ccd3819dc9897dccfb60f8: Status 404 returned error can't find the container with id f0a4f5a281604e80a6806207cc5a8d133490fb2be8ccd3819dc9897dccfb60f8
Jul 14 20:14:58.284144 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:58.284061    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:58.291889 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:58.291861    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g" event={"ID":"80977e30-da50-4216-9d60-06cde57fb761","Type":"ContainerStarted","Data":"f0a4f5a281604e80a6806207cc5a8d133490fb2be8ccd3819dc9897dccfb60f8"}
Jul 14 20:14:58.378188 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:58.378160    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:14:59.298162 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:59.298129    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g" event={"ID":"80977e30-da50-4216-9d60-06cde57fb761","Type":"ContainerStarted","Data":"3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670"}
Jul 14 20:14:59.298362 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:59.298252    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:14:59.316491 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:14:59.316443    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g" podStartSLOduration=1.726991599 podStartE2EDuration="2.316429544s" totalImagesPullingTime="589.437945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:14:59.314295831 +0000 UTC m=+2224.371815370" watchObservedRunningTime="2026-07-14 20:14:59.316429544 +0000 UTC m=+2224.373949084"
Jul 14 20:15:01.876509 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:01.876476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:15:05.307893 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:05.307867    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:15:11.283453 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:11.283415    2569 patch_prober.go:28] interesting pod/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 14 20:15:11.283890 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:11.283468    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 14 20:15:11.366030 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:11.365997    2569 generic.go:356] "Generic (PLEG): container finished" podID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerID="3a9b931a1f68de0588100125f5e3c2f8da1d44414c9780f348b4df9b6e66e1ca" exitCode=0
Jul 14 20:15:11.366180 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:11.366068    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" event={"ID":"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82","Type":"ContainerDied","Data":"3a9b931a1f68de0588100125f5e3c2f8da1d44414c9780f348b4df9b6e66e1ca"}
Jul 14 20:15:11.366500 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:11.366483    2569 scope.go:117] "RemoveContainer" containerID="3a9b931a1f68de0588100125f5e3c2f8da1d44414c9780f348b4df9b6e66e1ca"
Jul 14 20:15:11.367505 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:11.367474    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:15:11.367605 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:11.367563    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:15:11.367661 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:11.367611    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:15:12.372793 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:12.372753    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" event={"ID":"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82","Type":"ContainerStarted","Data":"ec498caa5921b00e27dca378c65791dfad898d523c69af7f653ee565ca9ba94b"}
Jul 14 20:15:13.004657 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:13.004620    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:15:13.004864 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:13.004842    2569 patch_prober.go:28] interesting pod/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 14 20:15:13.004924 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:13.004899    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 14 20:15:14.004736 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:14.004679    2569 patch_prober.go:28] interesting pod/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 14 20:15:14.005114 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:14.004748    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 14 20:15:14.381468 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:14.381437    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:15:15.005538 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:15.005498    2569 patch_prober.go:28] interesting pod/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 14 20:15:15.005961 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:15.005559    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 14 20:15:16.005041 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:16.005008    2569 patch_prober.go:28] interesting pod/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 14 20:15:16.005210 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:16.005058    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 14 20:15:17.008639 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:17.008562    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:15:17.008994 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:17.008907    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:15:17.009491 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:17.009475    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:15:55.826717 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:55.826663    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"]
Jul 14 20:15:55.827624 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:55.827588    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g" podUID="80977e30-da50-4216-9d60-06cde57fb761" containerName="maas-api" containerID="cri-o://3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670" gracePeriod=30
Jul 14 20:15:55.868934 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:55.868906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:15:56.079069 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.079017    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:15:56.174603 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.174574    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8jj5\" (UniqueName: \"kubernetes.io/projected/80977e30-da50-4216-9d60-06cde57fb761-kube-api-access-n8jj5\") pod \"80977e30-da50-4216-9d60-06cde57fb761\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") "
Jul 14 20:15:56.174767 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.174655    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80977e30-da50-4216-9d60-06cde57fb761-maas-api-tls\") pod \"80977e30-da50-4216-9d60-06cde57fb761\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") "
Jul 14 20:15:56.174767 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.174681    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80977e30-da50-4216-9d60-06cde57fb761-openshift-service-ca\") pod \"80977e30-da50-4216-9d60-06cde57fb761\" (UID: \"80977e30-da50-4216-9d60-06cde57fb761\") "
Jul 14 20:15:56.175058 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.175035    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80977e30-da50-4216-9d60-06cde57fb761-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80977e30-da50-4216-9d60-06cde57fb761" (UID: "80977e30-da50-4216-9d60-06cde57fb761"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:15:56.176624 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.176602    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80977e30-da50-4216-9d60-06cde57fb761-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80977e30-da50-4216-9d60-06cde57fb761" (UID: "80977e30-da50-4216-9d60-06cde57fb761"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:15:56.176751 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.176729    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80977e30-da50-4216-9d60-06cde57fb761-kube-api-access-n8jj5" (OuterVolumeSpecName: "kube-api-access-n8jj5") pod "80977e30-da50-4216-9d60-06cde57fb761" (UID: "80977e30-da50-4216-9d60-06cde57fb761"). InnerVolumeSpecName "kube-api-access-n8jj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:15:56.275356 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.275325    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80977e30-da50-4216-9d60-06cde57fb761-maas-api-tls\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:15:56.275356 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.275351    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80977e30-da50-4216-9d60-06cde57fb761-openshift-service-ca\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:15:56.275356 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.275361    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8jj5\" (UniqueName: \"kubernetes.io/projected/80977e30-da50-4216-9d60-06cde57fb761-kube-api-access-n8jj5\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:15:56.565244 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.565208    2569 generic.go:356] "Generic (PLEG): container finished" podID="80977e30-da50-4216-9d60-06cde57fb761" containerID="3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670" exitCode=0
Jul 14 20:15:56.565441 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.565252    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"
Jul 14 20:15:56.565441 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.565278    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g" event={"ID":"80977e30-da50-4216-9d60-06cde57fb761","Type":"ContainerDied","Data":"3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670"}
Jul 14 20:15:56.565441 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.565327    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g" event={"ID":"80977e30-da50-4216-9d60-06cde57fb761","Type":"ContainerDied","Data":"f0a4f5a281604e80a6806207cc5a8d133490fb2be8ccd3819dc9897dccfb60f8"}
Jul 14 20:15:56.565441 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.565354    2569 scope.go:117] "RemoveContainer" containerID="3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670"
Jul 14 20:15:56.573784 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.573758    2569 scope.go:117] "RemoveContainer" containerID="3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670"
Jul 14 20:15:56.574006 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:15:56.573989    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670\": container with ID starting with 3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670 not found: ID does not exist" containerID="3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670"
Jul 14 20:15:56.574097 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.574013    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670"} err="failed to get container status \"3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670\": rpc error: code = NotFound desc = could not find container \"3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670\": container with ID starting with 3d8a53e165d93f1f55e15f1acc50430d3453badf48ffd0104ed792f522287670 not found: ID does not exist"
Jul 14 20:15:56.585430 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.585402    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"]
Jul 14 20:15:56.589756 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:56.589731    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6023fdbc-d475d4d4b-x7q4g"]
Jul 14 20:15:57.444510 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:15:57.444470    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80977e30-da50-4216-9d60-06cde57fb761" path="/var/lib/kubelet/pods/80977e30-da50-4216-9d60-06cde57fb761/volumes"
Jul 14 20:16:00.416368 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:00.416336    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:05.496773 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:05.496729    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:21.791293 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:21.791257    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:41.636166 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:41.636130    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:43.437093 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:43.437057    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:48.759737 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:48.759644    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:49.217441 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:49.217411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:52.698933 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:52.698897    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"]
Jul 14 20:16:52.699372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:52.699168    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy" containerID="cri-o://ec498caa5921b00e27dca378c65791dfad898d523c69af7f653ee565ca9ba94b" gracePeriod=30
Jul 14 20:16:53.202087 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:53.202054    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:53.301055 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:53.301026    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:54.032113 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:54.032084    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:54.132953 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:54.132924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:54.235485 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:54.235452    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:55.037813 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:55.037783    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:55.134915 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:55.134887    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:57.396454 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:57.396411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:16:57.829092 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:57.829061    2569 generic.go:356] "Generic (PLEG): container finished" podID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerID="ec498caa5921b00e27dca378c65791dfad898d523c69af7f653ee565ca9ba94b" exitCode=0
Jul 14 20:16:57.829220 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:57.829103    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" event={"ID":"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82","Type":"ContainerDied","Data":"ec498caa5921b00e27dca378c65791dfad898d523c69af7f653ee565ca9ba94b"}
Jul 14 20:16:57.829220 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:57.829150    2569 scope.go:117] "RemoveContainer" containerID="3a9b931a1f68de0588100125f5e3c2f8da1d44414c9780f348b4df9b6e66e1ca"
Jul 14 20:16:57.952778 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:57.952756    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:16:58.082237 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082166    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-credential-socket\") pod \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") "
Jul 14 20:16:58.082237 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082199    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-podinfo\") pod \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") "
Jul 14 20:16:58.082237 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082236    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-token\") pod \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") "
Jul 14 20:16:58.082496 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082287    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-data\") pod \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") "
Jul 14 20:16:58.082496 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082312    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-socket\") pod \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") "
Jul 14 20:16:58.082496 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082350    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istiod-ca-cert\") pod \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") "
Jul 14 20:16:58.082496 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082384    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-certs\") pod \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") "
Jul 14 20:16:58.082496 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082419    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-envoy\") pod \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") "
Jul 14 20:16:58.082496 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082454    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" (UID: "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:16:58.082496 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082471    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkbd5\" (UniqueName: \"kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-kube-api-access-lkbd5\") pod \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\" (UID: \"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82\") "
Jul 14 20:16:58.082880 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082677    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:16:58.082880 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082670    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" (UID: "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:16:58.082880 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082677    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" (UID: "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:16:58.082880 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.082850    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" (UID: "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:16:58.083222 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.083195    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-data" (OuterVolumeSpecName: "istio-data") pod "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" (UID: "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:16:58.084436 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.084412    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-token" (OuterVolumeSpecName: "istio-token") pod "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" (UID: "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:16:58.084675 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.084655    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-kube-api-access-lkbd5" (OuterVolumeSpecName: "kube-api-access-lkbd5") pod "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" (UID: "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82"). InnerVolumeSpecName "kube-api-access-lkbd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:16:58.084855 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.084833    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" (UID: "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:16:58.084910 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.084863    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" (UID: "10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:16:58.183705 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.183669    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:16:58.183798 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.183690    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:16:58.183798 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.183720    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:16:58.183798 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.183729    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:16:58.183798 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.183737    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:16:58.183798 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.183745    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:16:58.183798 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.183752    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkbd5\" (UniqueName: \"kubernetes.io/projected/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-kube-api-access-lkbd5\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:16:58.183798 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.183761    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:16:58.834391 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.834356    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq" event={"ID":"10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82","Type":"ContainerDied","Data":"e3b4575e0b8d8c88cb9b8dfe05908f878bfb162dec58654c7323a42252557666"}
Jul 14 20:16:58.834391 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.834379    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"
Jul 14 20:16:58.834948 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.834414    2569 scope.go:117] "RemoveContainer" containerID="ec498caa5921b00e27dca378c65791dfad898d523c69af7f653ee565ca9ba94b"
Jul 14 20:16:58.855870 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.855848    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"]
Jul 14 20:16:58.859877 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:58.859856    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6023fdbc-openshift-default-7fd8f55d99-smwqq"]
Jul 14 20:16:59.444521 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:16:59.444487    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" path="/var/lib/kubelet/pods/10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82/volumes"
Jul 14 20:17:03.083312 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:03.083282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:03.190988 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:03.190961    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:03.784892 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:03.784862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:10.714151 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:10.714119    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:10.814078 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:10.814044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:20.567140 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:20.567106    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:20.930363 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:20.930331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:41.929982 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:41.929951    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:48.388651 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:48.388615    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:48.483067 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:48.483032    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:48.731120 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:48.731021    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:49.060201 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.060125    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"]
Jul 14 20:17:49.060434 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.060423    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy"
Jul 14 20:17:49.060481 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.060436    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy"
Jul 14 20:17:49.060481 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.060448    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80977e30-da50-4216-9d60-06cde57fb761" containerName="maas-api"
Jul 14 20:17:49.060481 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.060455    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="80977e30-da50-4216-9d60-06cde57fb761" containerName="maas-api"
Jul 14 20:17:49.060481 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.060462    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy"
Jul 14 20:17:49.060481 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.060468    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy"
Jul 14 20:17:49.060628 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.060523    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="80977e30-da50-4216-9d60-06cde57fb761" containerName="maas-api"
Jul 14 20:17:49.060628 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.060530    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy"
Jul 14 20:17:49.063324 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.063308    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.074026 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.074007    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a8298f-openshift-default-dockercfg-9crf9\""
Jul 14 20:17:49.095282 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.095259    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-token\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.095384 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.095310    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-certs\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.095384 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.095373    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-credential-socket\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.095460 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.095402    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-envoy\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.095460 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.095440    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-socket\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.095521 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.095468    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-podinfo\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.095521 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.095496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkvm\" (UniqueName: \"kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-kube-api-access-dfkvm\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.095589 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.095518    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-data\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.095589 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.095542    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istiod-ca-cert\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.116165 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.116143    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"]
Jul 14 20:17:49.133255 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.133233    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:49.196884 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.196855    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-data\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.196884 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.196886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istiod-ca-cert\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.197098 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.196924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-token\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.197098 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.196983    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-certs\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.197098 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.197019    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-credential-socket\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.197098 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.197046    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-envoy\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.197098 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.197073    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-socket\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.197098 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.197097    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-podinfo\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.197381 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.197134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkvm\" (UniqueName: \"kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-kube-api-access-dfkvm\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.197381 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.197350    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-data\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.197955 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.197926    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-credential-socket\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.198065 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.197960    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-socket\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.198130 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.197427    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-certs\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.198193 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.198164    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istiod-ca-cert\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.202112 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.200654    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-podinfo\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.203663 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.203632    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-envoy\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.207371 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.207345    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-token\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.207515 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.207500    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkvm\" (UniqueName: \"kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-kube-api-access-dfkvm\") pod \"e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") " pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.239518 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.239496    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:49.373262 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.373239    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:49.508575 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.508540    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"]
Jul 14 20:17:49.511182 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:17:49.511147    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948e683f_8ed6_46ca_9c0e_34312da8aaa6.slice/crio-5a7f54fd182d8265f6a53ef6ce5ed605213875c61af8bf8b32db52fac4ff441d WatchSource:0}: Error finding container 5a7f54fd182d8265f6a53ef6ce5ed605213875c61af8bf8b32db52fac4ff441d: Status 404 returned error can't find the container with id 5a7f54fd182d8265f6a53ef6ce5ed605213875c61af8bf8b32db52fac4ff441d
Jul 14 20:17:49.513298 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.513255    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:17:49.513381 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.513340    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:17:49.513463 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:49.513382    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:17:50.051817 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:50.051784    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" event={"ID":"948e683f-8ed6-46ca-9c0e-34312da8aaa6","Type":"ContainerStarted","Data":"f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0"}
Jul 14 20:17:50.051987 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:50.051834    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" event={"ID":"948e683f-8ed6-46ca-9c0e-34312da8aaa6","Type":"ContainerStarted","Data":"5a7f54fd182d8265f6a53ef6ce5ed605213875c61af8bf8b32db52fac4ff441d"}
Jul 14 20:17:50.076073 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:50.076031    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" podStartSLOduration=1.076016204 podStartE2EDuration="1.076016204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:17:50.073860043 +0000 UTC m=+2395.131379596" watchObservedRunningTime="2026-07-14 20:17:50.076016204 +0000 UTC m=+2395.133535743"
Jul 14 20:17:50.374445 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:50.374415    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:50.379568 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:50.379542    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:51.056595 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:51.056562    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:51.057528 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:51.057512    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:17:52.066957 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.066920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:52.146503 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.146476    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"]
Jul 14 20:17:52.146859 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.146845    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d4eb1e-b76c-4d42-a11e-f5dd7cc6ec82" containerName="istio-proxy"
Jul 14 20:17:52.149731 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.149684    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.151038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.151015    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:52.152380 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.152354    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a8298f-serving-cert\""
Jul 14 20:17:52.152498 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.152395    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfc6h\""
Jul 14 20:17:52.168597 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.168575    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"]
Jul 14 20:17:52.222924 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.222897    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5d36732-ee40-4252-b61a-2addbe47862e-maas-api-tls\") pod \"maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.223082 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.222933    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d36732-ee40-4252-b61a-2addbe47862e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.223082 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.222957    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbt6q\" (UniqueName: \"kubernetes.io/projected/c5d36732-ee40-4252-b61a-2addbe47862e-kube-api-access-dbt6q\") pod \"maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.235807 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.235780    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:52.323671 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.323603    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d36732-ee40-4252-b61a-2addbe47862e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.323671 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.323637    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbt6q\" (UniqueName: \"kubernetes.io/projected/c5d36732-ee40-4252-b61a-2addbe47862e-kube-api-access-dbt6q\") pod \"maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.323834 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.323721    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5d36732-ee40-4252-b61a-2addbe47862e-maas-api-tls\") pod \"maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.324329 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.324311    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d36732-ee40-4252-b61a-2addbe47862e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.326028 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.326011    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5d36732-ee40-4252-b61a-2addbe47862e-maas-api-tls\") pod \"maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.335322 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.335296    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbt6q\" (UniqueName: \"kubernetes.io/projected/c5d36732-ee40-4252-b61a-2addbe47862e-kube-api-access-dbt6q\") pod \"maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.335488 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.335465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:52.462106 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.462077    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:52.595709 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.595667    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"]
Jul 14 20:17:52.597688 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:17:52.597662    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d36732_ee40_4252_b61a_2addbe47862e.slice/crio-cb12245af64b8a9e87d6bfaa52903f81f59a37be7f7df30640ff2f6cb73c4ada WatchSource:0}: Error finding container cb12245af64b8a9e87d6bfaa52903f81f59a37be7f7df30640ff2f6cb73c4ada: Status 404 returned error can't find the container with id cb12245af64b8a9e87d6bfaa52903f81f59a37be7f7df30640ff2f6cb73c4ada
Jul 14 20:17:52.766509 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.766461    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:52.889077 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:52.889016    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:53.066338 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:53.066303    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm" event={"ID":"c5d36732-ee40-4252-b61a-2addbe47862e","Type":"ContainerStarted","Data":"cb12245af64b8a9e87d6bfaa52903f81f59a37be7f7df30640ff2f6cb73c4ada"}
Jul 14 20:17:54.071732 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:54.071683    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm" event={"ID":"c5d36732-ee40-4252-b61a-2addbe47862e","Type":"ContainerStarted","Data":"32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50"}
Jul 14 20:17:54.072144 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:54.071782    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:17:54.090427 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:54.090377    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm" podStartSLOduration=1.463386512 podStartE2EDuration="2.090363352s" totalImagesPullingTime="626.97684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:17:54.088917063 +0000 UTC m=+2399.146436593" watchObservedRunningTime="2026-07-14 20:17:54.090363352 +0000 UTC m=+2399.147882928"
Jul 14 20:17:55.538054 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:55.538022    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:17:55.541683 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:55.541659    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:17:55.608786 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:55.608760    2569 scope.go:117] "RemoveContainer" containerID="269dc7f15956ba823c6fa9e9e99f6c09e40ebca44b0c60af7bf8288799b2ccd9"
Jul 14 20:17:56.608048 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:56.608021    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:56.950172 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:56.950145    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:57.247686 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.245043    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"]
Jul 14 20:17:57.256680 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.256656    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.260959 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.260922    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3195eb-openshift-default-dockercfg-cs582\""
Jul 14 20:17:57.262838 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.262816    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"]
Jul 14 20:17:57.270962 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.270936    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:57.367582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.367553    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-podinfo\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.367582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.367586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-token\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.367814 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.367615    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-credential-socket\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.367814 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.367690    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-socket\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.367814 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.367741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-certs\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.367915 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.367828    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xlbs\" (UniqueName: \"kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-kube-api-access-9xlbs\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.367915 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.367860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-data\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.367915 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.367897    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3cdb952-230f-4fdd-a19d-c3877de47c33-istiod-ca-cert\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.368008 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.367934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-envoy\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.458690 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.458656    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:17:57.468630 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.468598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-envoy\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.468816 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.468644    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-podinfo\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.468816 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.468667    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-token\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.468816 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.468688    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-credential-socket\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.468816 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.468731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-socket\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.468816 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.468754    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-certs\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.468816 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.468812    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xlbs\" (UniqueName: \"kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-kube-api-access-9xlbs\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.469253 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.468843    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-data\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.469253 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.468880    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3cdb952-230f-4fdd-a19d-c3877de47c33-istiod-ca-cert\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.469410 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.469350    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-certs\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.469524 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.469504    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-credential-socket\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.469603 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.469527    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-data\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.469603 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.469576    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3cdb952-230f-4fdd-a19d-c3877de47c33-istiod-ca-cert\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.469723 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.469630    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-socket\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.471148 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.471127    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-envoy\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.471229 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.471186    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-podinfo\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.477524 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.477506    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-token\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.477899 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.477874    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xlbs\" (UniqueName: \"kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-kube-api-access-9xlbs\") pod \"e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") " pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.570781 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.570686    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:57.750599 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.750568    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"]
Jul 14 20:17:57.753486 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:17:57.753458    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3cdb952_230f_4fdd_a19d_c3877de47c33.slice/crio-e3b7a9d06e4b3bdf52f19ef35afbd7c71d4ef30254f9a7c7e5fce9e3e8b8823c WatchSource:0}: Error finding container e3b7a9d06e4b3bdf52f19ef35afbd7c71d4ef30254f9a7c7e5fce9e3e8b8823c: Status 404 returned error can't find the container with id e3b7a9d06e4b3bdf52f19ef35afbd7c71d4ef30254f9a7c7e5fce9e3e8b8823c
Jul 14 20:17:57.756197 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.756162    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:17:57.756301 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.756232    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:17:57.756301 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:57.756259    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:17:58.089616 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:58.089572    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" event={"ID":"c3cdb952-230f-4fdd-a19d-c3877de47c33","Type":"ContainerStarted","Data":"30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882"}
Jul 14 20:17:58.089836 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:58.089663    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" event={"ID":"c3cdb952-230f-4fdd-a19d-c3877de47c33","Type":"ContainerStarted","Data":"e3b7a9d06e4b3bdf52f19ef35afbd7c71d4ef30254f9a7c7e5fce9e3e8b8823c"}
Jul 14 20:17:58.115638 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:58.115578    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" podStartSLOduration=1.115559871 podStartE2EDuration="1.115559871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:17:58.115120543 +0000 UTC m=+2403.172640086" watchObservedRunningTime="2026-07-14 20:17:58.115559871 +0000 UTC m=+2403.173079512"
Jul 14 20:17:58.571711 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:58.571660    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:58.576499 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:58.576476    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:59.095997 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:59.095965    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:17:59.097118 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:17:59.097102    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:18:00.082290 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:00.082263    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:18:00.110025 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:00.109992    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:00.209894 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:00.209864    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:00.303593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:00.303563    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:00.451810 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:00.451774    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:00.836999 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:00.836850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:00.962573 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:00.962536    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:04.120734 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:04.120687    2569 generic.go:356] "Generic (PLEG): container finished" podID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerID="f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0" exitCode=0
Jul 14 20:18:04.121148 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:04.120748    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" event={"ID":"948e683f-8ed6-46ca-9c0e-34312da8aaa6","Type":"ContainerDied","Data":"f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0"}
Jul 14 20:18:04.121148 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:04.121112    2569 scope.go:117] "RemoveContainer" containerID="f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0"
Jul 14 20:18:04.122109 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:04.122076    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:18:04.122225 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:04.122142    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:18:04.122225 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:04.122173    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:18:04.630197 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:04.630156    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:05.126633 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:05.126602    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" event={"ID":"948e683f-8ed6-46ca-9c0e-34312da8aaa6","Type":"ContainerStarted","Data":"fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f"}
Jul 14 20:18:05.374059 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:05.374022    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:18:05.375226 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:05.375186    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 14 20:18:05.375341 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:05.375284    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 14 20:18:06.057182 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:06.057143    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:18:06.374046 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:06.374007    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 14 20:18:06.374649 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:06.374613    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 14 20:18:07.375204 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:07.375168    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 14 20:18:07.375839 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:07.375792    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 14 20:18:08.374335 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:08.374285    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 14 20:18:08.374538 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:08.374359    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 14 20:18:09.374652 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:09.374615    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 14 20:18:09.375173 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:09.374792    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 14 20:18:10.378951 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:10.378916    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:18:10.379925 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:10.379903    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:18:12.167308 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:12.167281    2569 generic.go:356] "Generic (PLEG): container finished" podID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerID="30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882" exitCode=0
Jul 14 20:18:12.167652 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:12.167349    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" event={"ID":"c3cdb952-230f-4fdd-a19d-c3877de47c33","Type":"ContainerDied","Data":"30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882"}
Jul 14 20:18:12.167746 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:12.167732    2569 scope.go:117] "RemoveContainer" containerID="30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882"
Jul 14 20:18:12.168713 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:12.168669    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:18:12.168770 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:12.168749    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:18:12.168812 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:12.168792    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:18:13.173689 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:13.173651    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" event={"ID":"c3cdb952-230f-4fdd-a19d-c3877de47c33","Type":"ContainerStarted","Data":"6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d"}
Jul 14 20:18:13.571625 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:13.571543    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:18:13.572622 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:13.572591    2569 patch_prober.go:28] interesting pod/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 14 20:18:13.572776 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:13.572656    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 14 20:18:13.685317 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:13.685284    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:13.788819 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:13.788790    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:14.096383 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:14.096350    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:18:14.571046 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:14.571011    2569 patch_prober.go:28] interesting pod/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 14 20:18:14.571419 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:14.571077    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 14 20:18:15.571654 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:15.571618    2569 patch_prober.go:28] interesting pod/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 14 20:18:15.572048 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:15.571679    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 14 20:18:16.571994 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:16.571953    2569 patch_prober.go:28] interesting pod/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Jul 14 20:18:16.572471 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:16.572011    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Jul 14 20:18:17.575824 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:17.575794    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:18:17.577016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:17.576994    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:18:21.919037 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:21.919002    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:22.021945 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:22.021915    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:25.730363 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:25.730333    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:18:46.018528 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:18:46.018494    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:08.601168 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:08.601133    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:09.593076 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:09.593040    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:10.224668 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:10.224636    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:10.326802 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:10.326771    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:14.303952 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:14.303913    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:16.271390 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:16.271349    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:16.372374 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:16.372348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:20.376040 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.376005    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:20.473305 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.473250    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:20.618018 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.617592    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"]
Jul 14 20:19:20.618018 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.617845    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm" podUID="c5d36732-ee40-4252-b61a-2addbe47862e" containerName="maas-api" containerID="cri-o://32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50" gracePeriod=30
Jul 14 20:19:20.649167 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.649145    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:20.869947 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.869921    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:19:20.914437 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.914364    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5d36732-ee40-4252-b61a-2addbe47862e-maas-api-tls\") pod \"c5d36732-ee40-4252-b61a-2addbe47862e\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") "
Jul 14 20:19:20.914437 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.914399    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbt6q\" (UniqueName: \"kubernetes.io/projected/c5d36732-ee40-4252-b61a-2addbe47862e-kube-api-access-dbt6q\") pod \"c5d36732-ee40-4252-b61a-2addbe47862e\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") "
Jul 14 20:19:20.914437 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.914421    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d36732-ee40-4252-b61a-2addbe47862e-openshift-service-ca\") pod \"c5d36732-ee40-4252-b61a-2addbe47862e\" (UID: \"c5d36732-ee40-4252-b61a-2addbe47862e\") "
Jul 14 20:19:20.914826 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.914804    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5d36732-ee40-4252-b61a-2addbe47862e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c5d36732-ee40-4252-b61a-2addbe47862e" (UID: "c5d36732-ee40-4252-b61a-2addbe47862e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:19:20.916413 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.916386    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5d36732-ee40-4252-b61a-2addbe47862e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c5d36732-ee40-4252-b61a-2addbe47862e" (UID: "c5d36732-ee40-4252-b61a-2addbe47862e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:19:20.916516 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:20.916493    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5d36732-ee40-4252-b61a-2addbe47862e-kube-api-access-dbt6q" (OuterVolumeSpecName: "kube-api-access-dbt6q") pod "c5d36732-ee40-4252-b61a-2addbe47862e" (UID: "c5d36732-ee40-4252-b61a-2addbe47862e"). InnerVolumeSpecName "kube-api-access-dbt6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:19:21.015100 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.015073    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5d36732-ee40-4252-b61a-2addbe47862e-maas-api-tls\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:21.015100 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.015099    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbt6q\" (UniqueName: \"kubernetes.io/projected/c5d36732-ee40-4252-b61a-2addbe47862e-kube-api-access-dbt6q\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:21.015248 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.015110    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5d36732-ee40-4252-b61a-2addbe47862e-openshift-service-ca\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:21.475073 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.475037    2569 generic.go:356] "Generic (PLEG): container finished" podID="c5d36732-ee40-4252-b61a-2addbe47862e" containerID="32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50" exitCode=0
Jul 14 20:19:21.475407 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.475084    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"
Jul 14 20:19:21.475407 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.475122    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm" event={"ID":"c5d36732-ee40-4252-b61a-2addbe47862e","Type":"ContainerDied","Data":"32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50"}
Jul 14 20:19:21.475407 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.475172    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm" event={"ID":"c5d36732-ee40-4252-b61a-2addbe47862e","Type":"ContainerDied","Data":"cb12245af64b8a9e87d6bfaa52903f81f59a37be7f7df30640ff2f6cb73c4ada"}
Jul 14 20:19:21.475407 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.475194    2569 scope.go:117] "RemoveContainer" containerID="32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50"
Jul 14 20:19:21.483117 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.483100    2569 scope.go:117] "RemoveContainer" containerID="32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50"
Jul 14 20:19:21.483397 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:19:21.483376    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50\": container with ID starting with 32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50 not found: ID does not exist" containerID="32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50"
Jul 14 20:19:21.483454 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.483407    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50"} err="failed to get container status \"32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50\": rpc error: code = NotFound desc = could not find container \"32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50\": container with ID starting with 32b527309bc4121cd096275e98ba15e0e308ed0c8030eeb389b183b404c48a50 not found: ID does not exist"
Jul 14 20:19:21.491018 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.490999    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"]
Jul 14 20:19:21.495065 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:21.495039    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a8298f-54db854b6d-vrxcm"]
Jul 14 20:19:23.445164 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:23.445129    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5d36732-ee40-4252-b61a-2addbe47862e" path="/var/lib/kubelet/pods/c5d36732-ee40-4252-b61a-2addbe47862e/volumes"
Jul 14 20:19:24.789714 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:24.789657    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:31.487079 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:31.487042    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:31.613102 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:31.613072    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:35.488507 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:35.488476    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"]
Jul 14 20:19:35.489059 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:35.488676    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy" containerID="cri-o://fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f" gracePeriod=30
Jul 14 20:19:35.518234 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:35.518205    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:35.750423 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:35.750328    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:36.671248 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:36.671197    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:36.768427 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:36.768398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:40.381202 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.381172    2569 patch_prober.go:28] interesting pod/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:19:40.381571 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.381231    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:19:40.738773 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.738752    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:19:40.780239 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780202    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-token\") pod \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") "
Jul 14 20:19:40.780239 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780238    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfkvm\" (UniqueName: \"kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-kube-api-access-dfkvm\") pod \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") "
Jul 14 20:19:40.780468 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780275    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istiod-ca-cert\") pod \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") "
Jul 14 20:19:40.780468 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780306    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-envoy\") pod \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") "
Jul 14 20:19:40.780468 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780343    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-socket\") pod \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") "
Jul 14 20:19:40.780468 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780386    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-certs\") pod \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") "
Jul 14 20:19:40.780468 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780449    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-credential-socket\") pod \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") "
Jul 14 20:19:40.780763 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780489    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-podinfo\") pod \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") "
Jul 14 20:19:40.780763 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780520    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-data\") pod \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\" (UID: \"948e683f-8ed6-46ca-9c0e-34312da8aaa6\") "
Jul 14 20:19:40.780865 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780816    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "948e683f-8ed6-46ca-9c0e-34312da8aaa6" (UID: "948e683f-8ed6-46ca-9c0e-34312da8aaa6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:19:40.780865 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780828    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "948e683f-8ed6-46ca-9c0e-34312da8aaa6" (UID: "948e683f-8ed6-46ca-9c0e-34312da8aaa6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:19:40.780865 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780830    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "948e683f-8ed6-46ca-9c0e-34312da8aaa6" (UID: "948e683f-8ed6-46ca-9c0e-34312da8aaa6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:19:40.781036 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.780884    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "948e683f-8ed6-46ca-9c0e-34312da8aaa6" (UID: "948e683f-8ed6-46ca-9c0e-34312da8aaa6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:19:40.781809 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.781780    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-data" (OuterVolumeSpecName: "istio-data") pod "948e683f-8ed6-46ca-9c0e-34312da8aaa6" (UID: "948e683f-8ed6-46ca-9c0e-34312da8aaa6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:19:40.782677 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.782655    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-token" (OuterVolumeSpecName: "istio-token") pod "948e683f-8ed6-46ca-9c0e-34312da8aaa6" (UID: "948e683f-8ed6-46ca-9c0e-34312da8aaa6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:19:40.782809 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.782679    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-kube-api-access-dfkvm" (OuterVolumeSpecName: "kube-api-access-dfkvm") pod "948e683f-8ed6-46ca-9c0e-34312da8aaa6" (UID: "948e683f-8ed6-46ca-9c0e-34312da8aaa6"). InnerVolumeSpecName "kube-api-access-dfkvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:19:40.782927 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.782907    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "948e683f-8ed6-46ca-9c0e-34312da8aaa6" (UID: "948e683f-8ed6-46ca-9c0e-34312da8aaa6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:19:40.782983 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.782965    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "948e683f-8ed6-46ca-9c0e-34312da8aaa6" (UID: "948e683f-8ed6-46ca-9c0e-34312da8aaa6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:19:40.881441 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.881413    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:40.881441 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.881438    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:40.881441 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.881448    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:40.881663 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.881456    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:40.881663 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.881464    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfkvm\" (UniqueName: \"kubernetes.io/projected/948e683f-8ed6-46ca-9c0e-34312da8aaa6-kube-api-access-dfkvm\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:40.881663 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.881473    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:40.881663 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.881481    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:40.881663 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.881489    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:40.881663 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:40.881497    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/948e683f-8ed6-46ca-9c0e-34312da8aaa6-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:19:41.562953 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.562916    2569 generic.go:356] "Generic (PLEG): container finished" podID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerID="fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f" exitCode=0
Jul 14 20:19:41.563390 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.562970    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"
Jul 14 20:19:41.563390 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.562980    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" event={"ID":"948e683f-8ed6-46ca-9c0e-34312da8aaa6","Type":"ContainerDied","Data":"fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f"}
Jul 14 20:19:41.563390 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.563030    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5" event={"ID":"948e683f-8ed6-46ca-9c0e-34312da8aaa6","Type":"ContainerDied","Data":"5a7f54fd182d8265f6a53ef6ce5ed605213875c61af8bf8b32db52fac4ff441d"}
Jul 14 20:19:41.563390 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.563063    2569 scope.go:117] "RemoveContainer" containerID="fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f"
Jul 14 20:19:41.573207 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.573142    2569 scope.go:117] "RemoveContainer" containerID="f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0"
Jul 14 20:19:41.580686 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.580672    2569 scope.go:117] "RemoveContainer" containerID="fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f"
Jul 14 20:19:41.580965 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:19:41.580939    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f\": container with ID starting with fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f not found: ID does not exist" containerID="fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f"
Jul 14 20:19:41.581063 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.580974    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f"} err="failed to get container status \"fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f\": rpc error: code = NotFound desc = could not find container \"fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f\": container with ID starting with fb6bb9cff593405d5c3e4f9b9e24c1ce626d4539919ac9124eafcbdfa0ebe93f not found: ID does not exist"
Jul 14 20:19:41.581063 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.580993    2569 scope.go:117] "RemoveContainer" containerID="f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0"
Jul 14 20:19:41.581195 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:19:41.581179    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0\": container with ID starting with f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0 not found: ID does not exist" containerID="f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0"
Jul 14 20:19:41.581235 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.581199    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0"} err="failed to get container status \"f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0\": rpc error: code = NotFound desc = could not find container \"f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0\": container with ID starting with f7fd2ee7e1eb858a686473d7a4fa2377b8e1100ce6f0f4bd4a25dfa3315f67d0 not found: ID does not exist"
Jul 14 20:19:41.586876 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.586850    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"]
Jul 14 20:19:41.594193 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:41.594171    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a8298f-openshift-default-75b78c77b5-vbrq5"]
Jul 14 20:19:43.444883 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:43.444849    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" path="/var/lib/kubelet/pods/948e683f-8ed6-46ca-9c0e-34312da8aaa6/volumes"
Jul 14 20:19:46.376774 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:46.376737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:50.972332 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:50.972295    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:57.043836 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:57.043786    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:19:57.145422 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:19:57.145389    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:01.713396 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:01.713355    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"]
Jul 14 20:20:01.713841 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:01.713550    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy" containerID="cri-o://6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d" gracePeriod=30
Jul 14 20:20:01.745149 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:01.745119    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:01.985610 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:01.985521    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:02.311673 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.311595    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:02.578278 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.578204    2569 patch_prober.go:28] interesting pod/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:20:02.578278 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.578263    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:20:02.635030 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.634997    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"]
Jul 14 20:20:02.635329 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.635317    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy"
Jul 14 20:20:02.635378 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.635330    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy"
Jul 14 20:20:02.635378 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.635340    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy"
Jul 14 20:20:02.635378 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.635345    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy"
Jul 14 20:20:02.635378 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.635362    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5d36732-ee40-4252-b61a-2addbe47862e" containerName="maas-api"
Jul 14 20:20:02.635378 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.635367    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5d36732-ee40-4252-b61a-2addbe47862e" containerName="maas-api"
Jul 14 20:20:02.635553 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.635413    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy"
Jul 14 20:20:02.635553 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.635421    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="948e683f-8ed6-46ca-9c0e-34312da8aaa6" containerName="istio-proxy"
Jul 14 20:20:02.635553 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.635427    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5d36732-ee40-4252-b61a-2addbe47862e" containerName="maas-api"
Jul 14 20:20:02.638145 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.638129    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.641114 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.641090    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c73bc1-openshift-default-dockercfg-h6cdg\""
Jul 14 20:20:02.659360 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.659338    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"]
Jul 14 20:20:02.701284 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.701252    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:02.761103 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.761075    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-envoy\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.761413 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.761111    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k69kp\" (UniqueName: \"kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-kube-api-access-k69kp\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.761413 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.761132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-data\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.761413 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.761191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d540154-21bd-4184-afed-57896165f4f9-istio-podinfo\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.761413 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.761208    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-certs\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.761413 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.761268    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-socket\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.761413 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.761319    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-credential-socket\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.761413 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.761337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-istio-token\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.761413 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.761353    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d540154-21bd-4184-afed-57896165f4f9-istiod-ca-cert\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.816139 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.816108    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:02.862304 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862240    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-credential-socket\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862304 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862269    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-istio-token\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862304 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862286    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d540154-21bd-4184-afed-57896165f4f9-istiod-ca-cert\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862524 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862327    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-envoy\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862524 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862346    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k69kp\" (UniqueName: \"kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-kube-api-access-k69kp\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862524 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862363    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-data\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862524 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d540154-21bd-4184-afed-57896165f4f9-istio-podinfo\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862524 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862407    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-certs\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862524 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-socket\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862890 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862663    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-credential-socket\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862890 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862748    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-data\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.862890 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.862863    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-certs\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.863064 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.863027    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-socket\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.863146 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.863122    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d540154-21bd-4184-afed-57896165f4f9-istiod-ca-cert\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.864724 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.864687    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-envoy\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.864817 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.864760    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d540154-21bd-4184-afed-57896165f4f9-istio-podinfo\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.873021 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.873003    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k69kp\" (UniqueName: \"kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-kube-api-access-k69kp\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.873110 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.873089    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-istio-token\") pod \"e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") " pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:02.948298 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:02.948274    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:03.083139 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:03.083109    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"]
Jul 14 20:20:03.084272 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:20:03.084244    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d540154_21bd_4184_afed_57896165f4f9.slice/crio-b1cf0838fe7d21217277f90638966c175cc0e685ca01978cf0a0d8bc217cf2bc WatchSource:0}: Error finding container b1cf0838fe7d21217277f90638966c175cc0e685ca01978cf0a0d8bc217cf2bc: Status 404 returned error can't find the container with id b1cf0838fe7d21217277f90638966c175cc0e685ca01978cf0a0d8bc217cf2bc
Jul 14 20:20:03.086328 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:03.086294    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:03.086401 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:03.086375    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:03.086439 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:03.086404    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:03.655840 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:03.655806    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" event={"ID":"9d540154-21bd-4184-afed-57896165f4f9","Type":"ContainerStarted","Data":"7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e"}
Jul 14 20:20:03.656061 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:03.655861    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" event={"ID":"9d540154-21bd-4184-afed-57896165f4f9","Type":"ContainerStarted","Data":"b1cf0838fe7d21217277f90638966c175cc0e685ca01978cf0a0d8bc217cf2bc"}
Jul 14 20:20:03.687648 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:03.687602    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" podStartSLOduration=1.68758874 podStartE2EDuration="1.68758874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:20:03.685869095 +0000 UTC m=+2528.743388634" watchObservedRunningTime="2026-07-14 20:20:03.68758874 +0000 UTC m=+2528.745108279"
Jul 14 20:20:03.949164 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:03.949090    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:04.953523 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:04.953495    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:05.665808 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:05.665774    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:05.666657 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:05.666636    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:05.795090 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:05.795047    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:05.909308 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:05.909279    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:06.485422 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:06.485383    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:06.585132 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:06.585093    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:06.704223 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:06.704183    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:06.803288 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:06.803211    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:06.965636 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:06.965611    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:20:07.100109 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100024    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xlbs\" (UniqueName: \"kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-kube-api-access-9xlbs\") pod \"c3cdb952-230f-4fdd-a19d-c3877de47c33\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") "
Jul 14 20:20:07.100109 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100069    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3cdb952-230f-4fdd-a19d-c3877de47c33-istiod-ca-cert\") pod \"c3cdb952-230f-4fdd-a19d-c3877de47c33\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") "
Jul 14 20:20:07.100109 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100102    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-socket\") pod \"c3cdb952-230f-4fdd-a19d-c3877de47c33\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") "
Jul 14 20:20:07.100374 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100125    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-envoy\") pod \"c3cdb952-230f-4fdd-a19d-c3877de47c33\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") "
Jul 14 20:20:07.100374 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100185    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-data\") pod \"c3cdb952-230f-4fdd-a19d-c3877de47c33\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") "
Jul 14 20:20:07.100374 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100222    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-podinfo\") pod \"c3cdb952-230f-4fdd-a19d-c3877de47c33\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") "
Jul 14 20:20:07.100374 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100273    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-credential-socket\") pod \"c3cdb952-230f-4fdd-a19d-c3877de47c33\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") "
Jul 14 20:20:07.100374 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100304    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-certs\") pod \"c3cdb952-230f-4fdd-a19d-c3877de47c33\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") "
Jul 14 20:20:07.100374 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100335    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-token\") pod \"c3cdb952-230f-4fdd-a19d-c3877de47c33\" (UID: \"c3cdb952-230f-4fdd-a19d-c3877de47c33\") "
Jul 14 20:20:07.100374 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100337    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3cdb952-230f-4fdd-a19d-c3877de47c33" (UID: "c3cdb952-230f-4fdd-a19d-c3877de47c33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:07.100767 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100505    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3cdb952-230f-4fdd-a19d-c3877de47c33" (UID: "c3cdb952-230f-4fdd-a19d-c3877de47c33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:07.100767 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100549    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3cdb952-230f-4fdd-a19d-c3877de47c33-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3cdb952-230f-4fdd-a19d-c3877de47c33" (UID: "c3cdb952-230f-4fdd-a19d-c3877de47c33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:20:07.100767 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100557    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3cdb952-230f-4fdd-a19d-c3877de47c33" (UID: "c3cdb952-230f-4fdd-a19d-c3877de47c33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:07.100767 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100691    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:07.100767 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100731    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:07.100767 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100745    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3cdb952-230f-4fdd-a19d-c3877de47c33-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:07.100767 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.100757    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:07.101508 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.101479    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3cdb952-230f-4fdd-a19d-c3877de47c33" (UID: "c3cdb952-230f-4fdd-a19d-c3877de47c33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:07.102624 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.102597    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3cdb952-230f-4fdd-a19d-c3877de47c33" (UID: "c3cdb952-230f-4fdd-a19d-c3877de47c33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:20:07.102624 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.102613    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3cdb952-230f-4fdd-a19d-c3877de47c33" (UID: "c3cdb952-230f-4fdd-a19d-c3877de47c33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:20:07.102773 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.102621    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3cdb952-230f-4fdd-a19d-c3877de47c33" (UID: "c3cdb952-230f-4fdd-a19d-c3877de47c33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:07.102773 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.102633    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-kube-api-access-9xlbs" (OuterVolumeSpecName: "kube-api-access-9xlbs") pod "c3cdb952-230f-4fdd-a19d-c3877de47c33" (UID: "c3cdb952-230f-4fdd-a19d-c3877de47c33"). InnerVolumeSpecName "kube-api-access-9xlbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:20:07.201298 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.201264    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xlbs\" (UniqueName: \"kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-kube-api-access-9xlbs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:07.201298 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.201292    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:07.201298 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.201302    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:07.201505 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.201310    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:07.201505 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.201317    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3cdb952-230f-4fdd-a19d-c3877de47c33-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:07.676391 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.676359    2569 generic.go:356] "Generic (PLEG): container finished" podID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerID="6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d" exitCode=0
Jul 14 20:20:07.676868 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.676413    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"
Jul 14 20:20:07.676868 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.676444    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" event={"ID":"c3cdb952-230f-4fdd-a19d-c3877de47c33","Type":"ContainerDied","Data":"6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d"}
Jul 14 20:20:07.676868 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.676498    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq" event={"ID":"c3cdb952-230f-4fdd-a19d-c3877de47c33","Type":"ContainerDied","Data":"e3b7a9d06e4b3bdf52f19ef35afbd7c71d4ef30254f9a7c7e5fce9e3e8b8823c"}
Jul 14 20:20:07.676868 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.676520    2569 scope.go:117] "RemoveContainer" containerID="6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d"
Jul 14 20:20:07.684556 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.684539    2569 scope.go:117] "RemoveContainer" containerID="30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882"
Jul 14 20:20:07.691971 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.691952    2569 scope.go:117] "RemoveContainer" containerID="6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d"
Jul 14 20:20:07.692219 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:20:07.692198    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d\": container with ID starting with 6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d not found: ID does not exist" containerID="6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d"
Jul 14 20:20:07.692278 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.692228    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d"} err="failed to get container status \"6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d\": rpc error: code = NotFound desc = could not find container \"6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d\": container with ID starting with 6ae81c6044f39dcb3cd0c8e1de02e56d32989c52ae4272e8dfe2a08fc5fb239d not found: ID does not exist"
Jul 14 20:20:07.692278 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.692245    2569 scope.go:117] "RemoveContainer" containerID="30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882"
Jul 14 20:20:07.692499 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:20:07.692484    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882\": container with ID starting with 30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882 not found: ID does not exist" containerID="30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882"
Jul 14 20:20:07.692587 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.692502    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882"} err="failed to get container status \"30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882\": rpc error: code = NotFound desc = could not find container \"30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882\": container with ID starting with 30596b21fd99db2dc67013ba778339be5297e1c3e3da1a837dd7ed59670bc882 not found: ID does not exist"
Jul 14 20:20:07.697860 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.697838    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"]
Jul 14 20:20:07.702282 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:07.702226    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3195eb-openshift-default-5894f5ddd5-wblsq"]
Jul 14 20:20:09.444526 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:09.444495    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" path="/var/lib/kubelet/pods/c3cdb952-230f-4fdd-a19d-c3877de47c33/volumes"
Jul 14 20:20:10.240511 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:10.240482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:10.742372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:10.742324    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:11.027456 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.027383    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"]
Jul 14 20:20:11.027724 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.027709    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy"
Jul 14 20:20:11.027775 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.027725    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy"
Jul 14 20:20:11.027811 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.027797    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy"
Jul 14 20:20:11.038627 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.038594    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.041836 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.041812    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6e455f-openshift-default-dockercfg-5td6b\""
Jul 14 20:20:11.046291 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.046051    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"]
Jul 14 20:20:11.069993 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.069967    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:11.135561 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.135533    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-socket\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.135729 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.135575    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-data\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.135729 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.135597    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istiod-ca-cert\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.135729 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.135671    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-credential-socket\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.135850 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.135733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4tb\" (UniqueName: \"kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-kube-api-access-lq4tb\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.135850 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.135763    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-envoy\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.135850 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.135798    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-podinfo\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.135850 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.135825    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-certs\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.135850 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.135839    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-token\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.236991 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.236950    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-credential-socket\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237009    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4tb\" (UniqueName: \"kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-kube-api-access-lq4tb\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237054    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-envoy\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-podinfo\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237138    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-certs\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237374 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-token\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237374 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237309    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-socket\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237505 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237384    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-credential-socket\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237505 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237403    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-data\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237505 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237454    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istiod-ca-cert\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237651 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237510    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-certs\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237651 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237553    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-socket\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.237774 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.237722    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-data\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.238060 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.238041    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istiod-ca-cert\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.239380 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.239358    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-envoy\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.239560 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.239543    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-podinfo\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.245610 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.245588    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4tb\" (UniqueName: \"kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-kube-api-access-lq4tb\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.245836 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.245817    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-token\") pod \"e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") " pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.350632 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.350563    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:11.496673 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.496645    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"]
Jul 14 20:20:11.499388 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:20:11.499362    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5abe7d_1e23_4a12_91e4_40cc2800bcdc.slice/crio-90ad25871aa83508bd3b762636901cc0d8bd807c4d959242f28f1d0e535ef165 WatchSource:0}: Error finding container 90ad25871aa83508bd3b762636901cc0d8bd807c4d959242f28f1d0e535ef165: Status 404 returned error can't find the container with id 90ad25871aa83508bd3b762636901cc0d8bd807c4d959242f28f1d0e535ef165
Jul 14 20:20:11.501449 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.501408    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:11.501535 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.501494    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:11.501576 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.501537    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:11.697788 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.697747    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" event={"ID":"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc","Type":"ContainerStarted","Data":"48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279"}
Jul 14 20:20:11.697970 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.697813    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" event={"ID":"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc","Type":"ContainerStarted","Data":"90ad25871aa83508bd3b762636901cc0d8bd807c4d959242f28f1d0e535ef165"}
Jul 14 20:20:11.967584 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:11.967498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:12.351628 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:12.351528    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:12.356487 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:12.356464    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:12.380732 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:12.380659    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" podStartSLOduration=1.380639425 podStartE2EDuration="1.380639425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:20:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:20:11.72761397 +0000 UTC m=+2536.785133512" watchObservedRunningTime="2026-07-14 20:20:12.380639425 +0000 UTC m=+2537.438158966"
Jul 14 20:20:12.702615 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:12.702582    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:12.703613 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:12.703592    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:13.755064 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.755028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:13.834552 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.834519    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"]
Jul 14 20:20:13.835305 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.835279    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy"
Jul 14 20:20:13.835448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.835436    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy"
Jul 14 20:20:13.835637 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.835625    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3cdb952-230f-4fdd-a19d-c3877de47c33" containerName="istio-proxy"
Jul 14 20:20:13.847858 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.847836    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:13.855077 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.855046    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"]
Jul 14 20:20:13.855335 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.855270    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfc6h\""
Jul 14 20:20:13.855828 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.855506    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-6e455f-serving-cert\""
Jul 14 20:20:13.858087 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.856988    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:13.862624 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.862600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-openshift-service-ca\") pod \"maas-api-e2e-api-b-6e455f-66694467b5-gvxzn\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:13.862869 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.862847    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-maas-api-tls\") pod \"maas-api-e2e-api-b-6e455f-66694467b5-gvxzn\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:13.863021 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.862992    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcchs\" (UniqueName: \"kubernetes.io/projected/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-kube-api-access-xcchs\") pod \"maas-api-e2e-api-b-6e455f-66694467b5-gvxzn\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:13.947740 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.944065    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:13.963359 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.963327    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-maas-api-tls\") pod \"maas-api-e2e-api-b-6e455f-66694467b5-gvxzn\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:13.963515 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.963370    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcchs\" (UniqueName: \"kubernetes.io/projected/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-kube-api-access-xcchs\") pod \"maas-api-e2e-api-b-6e455f-66694467b5-gvxzn\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:13.963515 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.963422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-openshift-service-ca\") pod \"maas-api-e2e-api-b-6e455f-66694467b5-gvxzn\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:13.964093 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.964072    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-openshift-service-ca\") pod \"maas-api-e2e-api-b-6e455f-66694467b5-gvxzn\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:13.965820 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.965797    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-maas-api-tls\") pod \"maas-api-e2e-api-b-6e455f-66694467b5-gvxzn\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:13.972774 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:13.972748    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcchs\" (UniqueName: \"kubernetes.io/projected/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-kube-api-access-xcchs\") pod \"maas-api-e2e-api-b-6e455f-66694467b5-gvxzn\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:14.050436 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:14.050340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:14.167759 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:14.167721    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:14.326857 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:14.326773    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"]
Jul 14 20:20:14.354863 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:20:14.354838    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7239b6d1_3c65_407b_91f9_d3d574d0f6ab.slice/crio-4757b496fbedfcf944b0fff494eabf58087e47d5c3a23d615d609afefa650389 WatchSource:0}: Error finding container 4757b496fbedfcf944b0fff494eabf58087e47d5c3a23d615d609afefa650389: Status 404 returned error can't find the container with id 4757b496fbedfcf944b0fff494eabf58087e47d5c3a23d615d609afefa650389
Jul 14 20:20:14.356372 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:14.356347    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 20:20:14.502926 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:14.502895    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:14.598656 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:14.598566    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:14.715033 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:14.714992    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn" event={"ID":"7239b6d1-3c65-407b-91f9-d3d574d0f6ab","Type":"ContainerStarted","Data":"4757b496fbedfcf944b0fff494eabf58087e47d5c3a23d615d609afefa650389"}
Jul 14 20:20:15.719832 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:15.719793    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn" event={"ID":"7239b6d1-3c65-407b-91f9-d3d574d0f6ab","Type":"ContainerStarted","Data":"d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80"}
Jul 14 20:20:15.720201 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:15.719930    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:15.738750 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:15.738667    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn" podStartSLOduration=2.30667104 podStartE2EDuration="2.738646958s" totalImagesPullingTime="431.975918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:20:15.736567464 +0000 UTC m=+2540.794087006" watchObservedRunningTime="2026-07-14 20:20:15.738646958 +0000 UTC m=+2540.796166498"
Jul 14 20:20:18.301260 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:18.301229    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:19.757177 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:19.757141    2569 generic.go:356] "Generic (PLEG): container finished" podID="9d540154-21bd-4184-afed-57896165f4f9" containerID="7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e" exitCode=0
Jul 14 20:20:19.757748 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:19.757193    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" event={"ID":"9d540154-21bd-4184-afed-57896165f4f9","Type":"ContainerDied","Data":"7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e"}
Jul 14 20:20:19.757748 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:19.757566    2569 scope.go:117] "RemoveContainer" containerID="7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e"
Jul 14 20:20:19.758606 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:19.758578    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:19.758657 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:19.758643    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:19.758714 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:19.758672    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:20.666512 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:20.666467    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:20.766534 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:20.766485    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" event={"ID":"9d540154-21bd-4184-afed-57896165f4f9","Type":"ContainerStarted","Data":"e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d"}
Jul 14 20:20:20.950107 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:20.950011    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:20.950447 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:20.950423    2569 patch_prober.go:28] interesting pod/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 14 20:20:20.950628 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:20.950604    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 14 20:20:21.740600 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:21.739967    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:20:21.949313 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:21.949278    2569 patch_prober.go:28] interesting pod/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 14 20:20:21.949918 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:21.949885    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 14 20:20:22.948846 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:22.948809    2569 patch_prober.go:28] interesting pod/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 14 20:20:22.949038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:22.948872    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 14 20:20:23.948949 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:23.948897    2569 patch_prober.go:28] interesting pod/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 14 20:20:23.949421 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:23.948971    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 14 20:20:24.952677 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:24.952648    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:24.953122 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:24.952937    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:24.953548 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:24.953532    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:25.792521 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:25.792451    2569 generic.go:356] "Generic (PLEG): container finished" podID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerID="48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279" exitCode=0
Jul 14 20:20:25.792721 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:25.792526    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" event={"ID":"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc","Type":"ContainerDied","Data":"48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279"}
Jul 14 20:20:25.793051 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:25.793036    2569 scope.go:117] "RemoveContainer" containerID="48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279"
Jul 14 20:20:25.793959 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:25.793930    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:25.794063 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:25.794016    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:25.794128 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:25.794064    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:20:26.799042 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:26.799001    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" event={"ID":"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc","Type":"ContainerStarted","Data":"4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276"}
Jul 14 20:20:27.318685 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:27.318636    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:27.351593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:27.351562    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:27.352622 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:27.352591    2569 patch_prober.go:28] interesting pod/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 14 20:20:27.352755 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:27.352651    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 14 20:20:27.418269 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:27.418205    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:27.703265 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:27.703229    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:28.351456 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:28.351424    2569 patch_prober.go:28] interesting pod/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 14 20:20:28.351882 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:28.351488    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 14 20:20:29.350983 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:29.350938    2569 patch_prober.go:28] interesting pod/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 14 20:20:29.351202 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:29.351023    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 14 20:20:30.351817 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:30.351776    2569 patch_prober.go:28] interesting pod/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 14 20:20:30.352255 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:30.351841    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 14 20:20:31.354899 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:31.354864    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:31.356328 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:31.356306    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:20:36.782456 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:36.782425    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:36.933740 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:36.933686    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:37.223935 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:37.223906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:39.256874 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:39.256839    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:39.361120 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:39.361093    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:41.694666 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:41.694637    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:47.923250 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:47.923221    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:48.024749 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:48.024715    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:52.422810 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:52.422779    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"]
Jul 14 20:20:52.423250 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:52.423032    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy" containerID="cri-o://e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d" gracePeriod=30
Jul 14 20:20:52.452241 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:52.452212    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:52.685455 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:52.685376    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:20:54.955170 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:54.955127    2569 patch_prober.go:28] interesting pod/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 14 20:20:54.955537 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:54.955195    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 14 20:20:57.677317 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.677288    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:57.858038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.857958    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-socket\") pod \"9d540154-21bd-4184-afed-57896165f4f9\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") "
Jul 14 20:20:57.858038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858003    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d540154-21bd-4184-afed-57896165f4f9-istiod-ca-cert\") pod \"9d540154-21bd-4184-afed-57896165f4f9\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") "
Jul 14 20:20:57.858038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858027    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-data\") pod \"9d540154-21bd-4184-afed-57896165f4f9\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") "
Jul 14 20:20:57.858333 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858149    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-istio-token\") pod \"9d540154-21bd-4184-afed-57896165f4f9\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") "
Jul 14 20:20:57.858333 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858185    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k69kp\" (UniqueName: \"kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-kube-api-access-k69kp\") pod \"9d540154-21bd-4184-afed-57896165f4f9\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") "
Jul 14 20:20:57.858333 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858209    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d540154-21bd-4184-afed-57896165f4f9" (UID: "9d540154-21bd-4184-afed-57896165f4f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:57.858333 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858236    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d540154-21bd-4184-afed-57896165f4f9-istio-podinfo\") pod \"9d540154-21bd-4184-afed-57896165f4f9\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") "
Jul 14 20:20:57.858333 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858295    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-certs\") pod \"9d540154-21bd-4184-afed-57896165f4f9\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") "
Jul 14 20:20:57.858333 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858325    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-envoy\") pod \"9d540154-21bd-4184-afed-57896165f4f9\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") "
Jul 14 20:20:57.858614 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858349    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-credential-socket\") pod \"9d540154-21bd-4184-afed-57896165f4f9\" (UID: \"9d540154-21bd-4184-afed-57896165f4f9\") "
Jul 14 20:20:57.858614 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858392    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d540154-21bd-4184-afed-57896165f4f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d540154-21bd-4184-afed-57896165f4f9" (UID: "9d540154-21bd-4184-afed-57896165f4f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:20:57.858614 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858520    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d540154-21bd-4184-afed-57896165f4f9" (UID: "9d540154-21bd-4184-afed-57896165f4f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:57.858804 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858643    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d540154-21bd-4184-afed-57896165f4f9-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:57.858804 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858651    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d540154-21bd-4184-afed-57896165f4f9" (UID: "9d540154-21bd-4184-afed-57896165f4f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:57.858804 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858660    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:57.858804 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858674    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:57.859009 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.858978    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d540154-21bd-4184-afed-57896165f4f9" (UID: "9d540154-21bd-4184-afed-57896165f4f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:57.860355 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.860324    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d540154-21bd-4184-afed-57896165f4f9" (UID: "9d540154-21bd-4184-afed-57896165f4f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:20:57.860488 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.860470    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d540154-21bd-4184-afed-57896165f4f9" (UID: "9d540154-21bd-4184-afed-57896165f4f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:20:57.860545 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.860511    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d540154-21bd-4184-afed-57896165f4f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d540154-21bd-4184-afed-57896165f4f9" (UID: "9d540154-21bd-4184-afed-57896165f4f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:20:57.860586 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.860565    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-kube-api-access-k69kp" (OuterVolumeSpecName: "kube-api-access-k69kp") pod "9d540154-21bd-4184-afed-57896165f4f9" (UID: "9d540154-21bd-4184-afed-57896165f4f9"). InnerVolumeSpecName "kube-api-access-k69kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:20:57.936873 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.936843    2569 generic.go:356] "Generic (PLEG): container finished" podID="9d540154-21bd-4184-afed-57896165f4f9" containerID="e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d" exitCode=0
Jul 14 20:20:57.937002 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.936886    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" event={"ID":"9d540154-21bd-4184-afed-57896165f4f9","Type":"ContainerDied","Data":"e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d"}
Jul 14 20:20:57.937002 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.936949    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j" event={"ID":"9d540154-21bd-4184-afed-57896165f4f9","Type":"ContainerDied","Data":"b1cf0838fe7d21217277f90638966c175cc0e685ca01978cf0a0d8bc217cf2bc"}
Jul 14 20:20:57.937002 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.936972    2569 scope.go:117] "RemoveContainer" containerID="e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d"
Jul 14 20:20:57.937002 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.936895    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"
Jul 14 20:20:57.945303 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.945286    2569 scope.go:117] "RemoveContainer" containerID="7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e"
Jul 14 20:20:57.952768 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.952751    2569 scope.go:117] "RemoveContainer" containerID="e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d"
Jul 14 20:20:57.952987 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:20:57.952969    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d\": container with ID starting with e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d not found: ID does not exist" containerID="e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d"
Jul 14 20:20:57.953032 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.952995    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d"} err="failed to get container status \"e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d\": rpc error: code = NotFound desc = could not find container \"e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d\": container with ID starting with e4ecbb6bd209fb82f7884061ff41c0a0d9220e8af37e34820456bae532719b5d not found: ID does not exist"
Jul 14 20:20:57.953032 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.953011    2569 scope.go:117] "RemoveContainer" containerID="7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e"
Jul 14 20:20:57.953241 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:20:57.953227    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e\": container with ID starting with 7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e not found: ID does not exist" containerID="7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e"
Jul 14 20:20:57.953285 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.953246    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e"} err="failed to get container status \"7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e\": rpc error: code = NotFound desc = could not find container \"7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e\": container with ID starting with 7e7773f7d531fb1717354c90b516342ea9ecb581609bd31b35d712b3f313850e not found: ID does not exist"
Jul 14 20:20:57.960074 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.960053    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:57.960156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.960079    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:57.960156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.960094    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d540154-21bd-4184-afed-57896165f4f9-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:57.960156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.960107    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:57.960156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.960118    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k69kp\" (UniqueName: \"kubernetes.io/projected/9d540154-21bd-4184-afed-57896165f4f9-kube-api-access-k69kp\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:57.960156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.960131    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d540154-21bd-4184-afed-57896165f4f9-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:20:57.960506 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.960490    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"]
Jul 14 20:20:57.964262 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:57.964243    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c73bc1-openshift-default-585ff9b8b9-shw4j"]
Jul 14 20:20:59.444664 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:20:59.444632    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d540154-21bd-4184-afed-57896165f4f9" path="/var/lib/kubelet/pods/9d540154-21bd-4184-afed-57896165f4f9/volumes"
Jul 14 20:21:03.624977 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.624944    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"]
Jul 14 20:21:03.625446 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.625176    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn" podUID="7239b6d1-3c65-407b-91f9-d3d574d0f6ab" containerName="maas-api" containerID="cri-o://d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80" gracePeriod=30
Jul 14 20:21:03.673232 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.673211    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:03.872852 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.872828    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:21:03.907825 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.907775    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-maas-api-tls\") pod \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") "
Jul 14 20:21:03.907825 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.907817    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcchs\" (UniqueName: \"kubernetes.io/projected/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-kube-api-access-xcchs\") pod \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") "
Jul 14 20:21:03.907988 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.907890    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-openshift-service-ca\") pod \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\" (UID: \"7239b6d1-3c65-407b-91f9-d3d574d0f6ab\") "
Jul 14 20:21:03.908283 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.908261    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7239b6d1-3c65-407b-91f9-d3d574d0f6ab" (UID: "7239b6d1-3c65-407b-91f9-d3d574d0f6ab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:21:03.909894 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.909872    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7239b6d1-3c65-407b-91f9-d3d574d0f6ab" (UID: "7239b6d1-3c65-407b-91f9-d3d574d0f6ab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:21:03.910000 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.909977    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-kube-api-access-xcchs" (OuterVolumeSpecName: "kube-api-access-xcchs") pod "7239b6d1-3c65-407b-91f9-d3d574d0f6ab" (UID: "7239b6d1-3c65-407b-91f9-d3d574d0f6ab"). InnerVolumeSpecName "kube-api-access-xcchs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:21:03.969774 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.969740    2569 generic.go:356] "Generic (PLEG): container finished" podID="7239b6d1-3c65-407b-91f9-d3d574d0f6ab" containerID="d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80" exitCode=0
Jul 14 20:21:03.969905 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.969786    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"
Jul 14 20:21:03.969905 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.969803    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn" event={"ID":"7239b6d1-3c65-407b-91f9-d3d574d0f6ab","Type":"ContainerDied","Data":"d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80"}
Jul 14 20:21:03.969905 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.969855    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn" event={"ID":"7239b6d1-3c65-407b-91f9-d3d574d0f6ab","Type":"ContainerDied","Data":"4757b496fbedfcf944b0fff494eabf58087e47d5c3a23d615d609afefa650389"}
Jul 14 20:21:03.969905 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.969885    2569 scope.go:117] "RemoveContainer" containerID="d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80"
Jul 14 20:21:03.980038 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.980016    2569 scope.go:117] "RemoveContainer" containerID="d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80"
Jul 14 20:21:03.980323 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:21:03.980292    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80\": container with ID starting with d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80 not found: ID does not exist" containerID="d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80"
Jul 14 20:21:03.980378 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.980317    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80"} err="failed to get container status \"d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80\": rpc error: code = NotFound desc = could not find container \"d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80\": container with ID starting with d6305edb78c22c50e1de6a4a8a071733c8f0a6b49399f3a652d27b22496a8b80 not found: ID does not exist"
Jul 14 20:21:03.999781 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:03.999757    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"]
Jul 14 20:21:04.006195 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:04.006175    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e455f-66694467b5-gvxzn"]
Jul 14 20:21:04.008946 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:04.008930    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcchs\" (UniqueName: \"kubernetes.io/projected/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-kube-api-access-xcchs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:04.009011 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:04.008948    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-openshift-service-ca\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:04.009011 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:04.008960    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7239b6d1-3c65-407b-91f9-d3d574d0f6ab-maas-api-tls\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:05.444815 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:05.444779    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7239b6d1-3c65-407b-91f9-d3d574d0f6ab" path="/var/lib/kubelet/pods/7239b6d1-3c65-407b-91f9-d3d574d0f6ab/volumes"
Jul 14 20:21:07.957418 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:07.957385    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:15.065229 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:15.065194    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:15.173691 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:15.173657    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:18.679776 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:18.679681    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"]
Jul 14 20:21:18.680140 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:18.679920    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy" containerID="cri-o://4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276" gracePeriod=30
Jul 14 20:21:18.706151 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:18.706115    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:18.941291 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:18.941219    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:19.312844 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.312770    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:19.706820 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.706783    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"]
Jul 14 20:21:19.707177 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.707097    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7239b6d1-3c65-407b-91f9-d3d574d0f6ab" containerName="maas-api"
Jul 14 20:21:19.707177 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.707108    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7239b6d1-3c65-407b-91f9-d3d574d0f6ab" containerName="maas-api"
Jul 14 20:21:19.707177 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.707126    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy"
Jul 14 20:21:19.707177 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.707132    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy"
Jul 14 20:21:19.707177 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.707139    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy"
Jul 14 20:21:19.707177 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.707144    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy"
Jul 14 20:21:19.707368 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.707194    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy"
Jul 14 20:21:19.707368 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.707201    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7239b6d1-3c65-407b-91f9-d3d574d0f6ab" containerName="maas-api"
Jul 14 20:21:19.711599 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.711582    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.714496 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.714476    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-76db83-openshift-default-dockercfg-zpgq4\""
Jul 14 20:21:19.739187 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.739164    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-certs\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.739294 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.739196    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-envoy\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.739294 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.739215    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3426925-346d-46d5-9fd6-a46577224567-istio-podinfo\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.739294 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.739239    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-data\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.739426 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.739304    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3426925-346d-46d5-9fd6-a46577224567-istiod-ca-cert\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.739426 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.739354    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-socket\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.739426 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.739393    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7grt\" (UniqueName: \"kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-kube-api-access-l7grt\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.739626 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.739477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-istio-token\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.739626 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.739528    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-credential-socket\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.755798 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.755773    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"]
Jul 14 20:21:19.759293 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.759273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:19.840593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.840560    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-certs\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.840593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.840599    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-envoy\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.840828 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.840616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3426925-346d-46d5-9fd6-a46577224567-istio-podinfo\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.840828 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.840655    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-data\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.840828 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.840681    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3426925-346d-46d5-9fd6-a46577224567-istiod-ca-cert\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.840828 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.840750    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-socket\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.840828 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.840801    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7grt\" (UniqueName: \"kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-kube-api-access-l7grt\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.840828 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.840827    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-istio-token\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.841156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.840867    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-credential-socket\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.841156 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.841003    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-certs\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.841527 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.841503    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-data\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.841636 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.841507    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3426925-346d-46d5-9fd6-a46577224567-istiod-ca-cert\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.841636 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.841575    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-socket\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.841636 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.841626    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-credential-socket\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.842957 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.842934    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-envoy\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.843199 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.843184    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3426925-346d-46d5-9fd6-a46577224567-istio-podinfo\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.855728 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.855683    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7grt\" (UniqueName: \"kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-kube-api-access-l7grt\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:19.856656 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:19.856636    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-istio-token\") pod \"e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") " pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:20.021598 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:20.021521    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:20.165016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:20.164986    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"]
Jul 14 20:21:20.166240 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:21:20.166216    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3426925_346d_46d5_9fd6_a46577224567.slice/crio-bda273657c97d1d0c512260a761a1b8126e80fbb947904136591e903c76fa0c1 WatchSource:0}: Error finding container bda273657c97d1d0c512260a761a1b8126e80fbb947904136591e903c76fa0c1: Status 404 returned error can't find the container with id bda273657c97d1d0c512260a761a1b8126e80fbb947904136591e903c76fa0c1
Jul 14 20:21:20.168235 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:20.168202    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:20.168335 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:20.168273    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:20.168335 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:20.168314    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:20.305351 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:20.305255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:21.060552 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:21.060517    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" event={"ID":"c3426925-346d-46d5-9fd6-a46577224567","Type":"ContainerStarted","Data":"1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7"}
Jul 14 20:21:21.061057 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:21.060596    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" event={"ID":"c3426925-346d-46d5-9fd6-a46577224567","Type":"ContainerStarted","Data":"bda273657c97d1d0c512260a761a1b8126e80fbb947904136591e903c76fa0c1"}
Jul 14 20:21:21.108634 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:21.108587    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" podStartSLOduration=2.108573378 podStartE2EDuration="2.108573378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:21:21.108344889 +0000 UTC m=+2606.165864430" watchObservedRunningTime="2026-07-14 20:21:21.108573378 +0000 UTC m=+2606.166092918"
Jul 14 20:21:22.022093 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:22.022062    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:22.026838 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:22.026815    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:22.065260 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:22.065232    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:22.065969 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:22.065949    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:23.259987 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.259956    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:23.377540 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.377507    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"]
Jul 14 20:21:23.377900 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.377886    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d540154-21bd-4184-afed-57896165f4f9" containerName="istio-proxy"
Jul 14 20:21:23.381043 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.381027    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:23.387168 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.387146    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-76db83-serving-cert\""
Jul 14 20:21:23.387296 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.387196    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfc6h\""
Jul 14 20:21:23.436275 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.436250    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"]
Jul 14 20:21:23.472011 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.471974    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becc3ac5-126e-468b-9371-edc39a5ab9d7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:23.472356 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.472337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becc3ac5-126e-468b-9371-edc39a5ab9d7-maas-api-tls\") pod \"maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:23.472492 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.472474    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg8jd\" (UniqueName: \"kubernetes.io/projected/becc3ac5-126e-468b-9371-edc39a5ab9d7-kube-api-access-tg8jd\") pod \"maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:23.519144 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.519063    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:23.572960 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.572933    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becc3ac5-126e-468b-9371-edc39a5ab9d7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:23.573069 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.572987    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becc3ac5-126e-468b-9371-edc39a5ab9d7-maas-api-tls\") pod \"maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:23.573069 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.573013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg8jd\" (UniqueName: \"kubernetes.io/projected/becc3ac5-126e-468b-9371-edc39a5ab9d7-kube-api-access-tg8jd\") pod \"maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:23.573147 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:21:23.573135    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-serving-cert: secret "maas-api-e2e-shared-a-76db83-serving-cert" not found
Jul 14 20:21:23.573205 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:21:23.573193    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/becc3ac5-126e-468b-9371-edc39a5ab9d7-maas-api-tls podName:becc3ac5-126e-468b-9371-edc39a5ab9d7 nodeName:}" failed. No retries permitted until 2026-07-14 20:21:24.073175441 +0000 UTC m=+2609.130694970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/becc3ac5-126e-468b-9371-edc39a5ab9d7-maas-api-tls") pod "maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn" (UID: "becc3ac5-126e-468b-9371-edc39a5ab9d7") : secret "maas-api-e2e-shared-a-76db83-serving-cert" not found
Jul 14 20:21:23.573518 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.573498    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becc3ac5-126e-468b-9371-edc39a5ab9d7-openshift-service-ca\") pod \"maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:23.584467 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.584446    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg8jd\" (UniqueName: \"kubernetes.io/projected/becc3ac5-126e-468b-9371-edc39a5ab9d7-kube-api-access-tg8jd\") pod \"maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:23.638714 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.638675    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:23.884543 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.884513    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:23.921866 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.921843    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:21:23.976877 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.976847    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istiod-ca-cert\") pod \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") "
Jul 14 20:21:23.977061 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.976884    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-credential-socket\") pod \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") "
Jul 14 20:21:23.977061 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.976918    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-envoy\") pod \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") "
Jul 14 20:21:23.977061 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.976958    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq4tb\" (UniqueName: \"kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-kube-api-access-lq4tb\") pod \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") "
Jul 14 20:21:23.977061 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.976981    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-socket\") pod \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") "
Jul 14 20:21:23.977061 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977022    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-podinfo\") pod \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") "
Jul 14 20:21:23.977396 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977067    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-certs\") pod \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") "
Jul 14 20:21:23.977396 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977115    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-data\") pod \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") "
Jul 14 20:21:23.977396 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977135    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" (UID: "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:21:23.977396 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977149    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-token\") pod \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\" (UID: \"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc\") "
Jul 14 20:21:23.977396 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977299    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" (UID: "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:21:23.977396 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977340    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" (UID: "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:21:23.977752 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977548    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:23.977752 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977570    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:23.977752 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977585    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:23.977752 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977606    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" (UID: "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:21:23.977972 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.977937    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" (UID: "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:21:23.979755 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.979689    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-kube-api-access-lq4tb" (OuterVolumeSpecName: "kube-api-access-lq4tb") pod "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" (UID: "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc"). InnerVolumeSpecName "kube-api-access-lq4tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:21:23.979755 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.979717    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" (UID: "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:21:23.979755 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.979715    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" (UID: "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:21:23.980018 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:23.979978    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" (UID: "7c5abe7d-1e23-4a12-91e4-40cc2800bcdc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:21:24.075485 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.075395    2569 generic.go:356] "Generic (PLEG): container finished" podID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerID="4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276" exitCode=0
Jul 14 20:21:24.075485 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.075466    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"
Jul 14 20:21:24.075723 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.075485    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" event={"ID":"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc","Type":"ContainerDied","Data":"4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276"}
Jul 14 20:21:24.075822 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.075790    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw" event={"ID":"7c5abe7d-1e23-4a12-91e4-40cc2800bcdc","Type":"ContainerDied","Data":"90ad25871aa83508bd3b762636901cc0d8bd807c4d959242f28f1d0e535ef165"}
Jul 14 20:21:24.076211 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.075991    2569 scope.go:117] "RemoveContainer" containerID="4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276"
Jul 14 20:21:24.082384 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.082362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becc3ac5-126e-468b-9371-edc39a5ab9d7-maas-api-tls\") pod \"maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:24.082556 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.082524    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:24.082840 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.082822    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:24.082919 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.082846    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:24.082919 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.082862    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq4tb\" (UniqueName: \"kubernetes.io/projected/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-kube-api-access-lq4tb\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:24.082919 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.082875    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:24.083046 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.082889    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:21:24.085276 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.085250    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becc3ac5-126e-468b-9371-edc39a5ab9d7-maas-api-tls\") pod \"maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:24.091228 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.091206    2569 scope.go:117] "RemoveContainer" containerID="48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279"
Jul 14 20:21:24.098681 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.098666    2569 scope.go:117] "RemoveContainer" containerID="4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276"
Jul 14 20:21:24.098944 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:21:24.098923    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276\": container with ID starting with 4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276 not found: ID does not exist" containerID="4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276"
Jul 14 20:21:24.099016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.098956    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276"} err="failed to get container status \"4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276\": rpc error: code = NotFound desc = could not find container \"4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276\": container with ID starting with 4c97816e944147e31f80693cb97123d30869696d833714c90e7983664a62c276 not found: ID does not exist"
Jul 14 20:21:24.099016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.098980    2569 scope.go:117] "RemoveContainer" containerID="48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279"
Jul 14 20:21:24.099238 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:21:24.099221    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279\": container with ID starting with 48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279 not found: ID does not exist" containerID="48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279"
Jul 14 20:21:24.099278 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.099243    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279"} err="failed to get container status \"48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279\": rpc error: code = NotFound desc = could not find container \"48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279\": container with ID starting with 48da186c898176ba476e801e4bb205aa1bba7e0044e336b18892bbc4b67e8279 not found: ID does not exist"
Jul 14 20:21:24.113534 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.113514    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"]
Jul 14 20:21:24.119087 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.119068    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6e455f-openshift-default-5f98b4c47f-5bbsw"]
Jul 14 20:21:24.291112 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.291079    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:24.448197 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.448177    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"]
Jul 14 20:21:24.450089 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:21:24.450063    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbecc3ac5_126e_468b_9371_edc39a5ab9d7.slice/crio-3ff29567859d2a3f49fd0bd1be6a713d443d1d7f7526a87ff058485ef3d100cf WatchSource:0}: Error finding container 3ff29567859d2a3f49fd0bd1be6a713d443d1d7f7526a87ff058485ef3d100cf: Status 404 returned error can't find the container with id 3ff29567859d2a3f49fd0bd1be6a713d443d1d7f7526a87ff058485ef3d100cf
Jul 14 20:21:24.454951 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.454928    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:24.717587 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.717559    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:24.843938 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:24.843908    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:25.082464 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:25.082374    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn" event={"ID":"becc3ac5-126e-468b-9371-edc39a5ab9d7","Type":"ContainerStarted","Data":"7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76"}
Jul 14 20:21:25.082464 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:25.082425    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn" event={"ID":"becc3ac5-126e-468b-9371-edc39a5ab9d7","Type":"ContainerStarted","Data":"3ff29567859d2a3f49fd0bd1be6a713d443d1d7f7526a87ff058485ef3d100cf"}
Jul 14 20:21:25.082718 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:25.082484    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:25.114597 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:25.114552    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn" podStartSLOduration=1.671548654 podStartE2EDuration="2.114538367s" totalImagesPullingTime="442.989713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:21:25.11436312 +0000 UTC m=+2610.171882662" watchObservedRunningTime="2026-07-14 20:21:25.114538367 +0000 UTC m=+2610.172057906"
Jul 14 20:21:25.445544 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:25.445513    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" path="/var/lib/kubelet/pods/7c5abe7d-1e23-4a12-91e4-40cc2800bcdc/volumes"
Jul 14 20:21:27.749501 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:27.749467    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:28.096341 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.096256    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:28.405499 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.405469    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"]
Jul 14 20:21:28.405857 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.405843    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy"
Jul 14 20:21:28.405911 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.405859    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy"
Jul 14 20:21:28.405911 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.405874    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy"
Jul 14 20:21:28.405911 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.405880    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy"
Jul 14 20:21:28.406006 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.405930    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy"
Jul 14 20:21:28.406006 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.405938    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c5abe7d-1e23-4a12-91e4-40cc2800bcdc" containerName="istio-proxy"
Jul 14 20:21:28.409389 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.409364    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.412616 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.412597    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ecc78d-openshift-default-dockercfg-tgwkr\""
Jul 14 20:21:28.441871 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.441831    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"]
Jul 14 20:21:28.452504 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.452475    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:28.518469 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.518437    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-data\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.518656 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.518483    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-credential-socket\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.518656 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.518511    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3be575b-62db-4f43-81d8-9ffb03158195-istio-podinfo\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.518656 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.518589    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-envoy\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.518656 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.518635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-certs\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.518902 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.518676    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-istio-token\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.518902 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.518742    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-socket\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.518902 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.518771    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv696\" (UniqueName: \"kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-kube-api-access-pv696\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.518902 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.518799    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3be575b-62db-4f43-81d8-9ffb03158195-istiod-ca-cert\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.619860 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.619822    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-envoy\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620072 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.619871    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-certs\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620072 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.619893    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-istio-token\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620072 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.619929    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-socket\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620072 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.619961    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv696\" (UniqueName: \"kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-kube-api-access-pv696\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620072 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.620002    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3be575b-62db-4f43-81d8-9ffb03158195-istiod-ca-cert\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620072 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.620037    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-data\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620397 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.620204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-credential-socket\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620397 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.620271    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3be575b-62db-4f43-81d8-9ffb03158195-istio-podinfo\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620397 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.620340    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-certs\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620563 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.620500    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-socket\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620621 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.620602    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-data\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620681 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.620658    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-credential-socket\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.620762 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.620750    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3be575b-62db-4f43-81d8-9ffb03158195-istiod-ca-cert\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.622233 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.622209    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-envoy\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.622657 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.622640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3be575b-62db-4f43-81d8-9ffb03158195-istio-podinfo\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.631379 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.631339    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-istio-token\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.632192 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.632100    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv696\" (UniqueName: \"kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-kube-api-access-pv696\") pod \"e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") " pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.641265 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.641208    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:28.719322 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.719231    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:28.914598 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.914570    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"]
Jul 14 20:21:28.916518 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:21:28.916493    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3be575b_62db_4f43_81d8_9ffb03158195.slice/crio-fcb4e56af6f4446e3f349b35b0f3877bb115f2d0d979d31570768fc441b76751 WatchSource:0}: Error finding container fcb4e56af6f4446e3f349b35b0f3877bb115f2d0d979d31570768fc441b76751: Status 404 returned error can't find the container with id fcb4e56af6f4446e3f349b35b0f3877bb115f2d0d979d31570768fc441b76751
Jul 14 20:21:28.918487 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.918454    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:28.918567 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.918517    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:28.918567 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:28.918545    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:29.103845 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:29.103796    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" event={"ID":"d3be575b-62db-4f43-81d8-9ffb03158195","Type":"ContainerStarted","Data":"6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3"}
Jul 14 20:21:29.104045 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:29.103882    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" event={"ID":"d3be575b-62db-4f43-81d8-9ffb03158195","Type":"ContainerStarted","Data":"fcb4e56af6f4446e3f349b35b0f3877bb115f2d0d979d31570768fc441b76751"}
Jul 14 20:21:29.132909 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:29.132830    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" podStartSLOduration=1.132806058 podStartE2EDuration="1.132806058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:21:29.130328514 +0000 UTC m=+2614.187848055" watchObservedRunningTime="2026-07-14 20:21:29.132806058 +0000 UTC m=+2614.190325599"
Jul 14 20:21:29.719773 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:29.719737    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:29.728815 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:29.728787    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:30.109380 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:30.109293    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:30.110380 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:30.110361    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:31.094382 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:31.094351    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:21:31.273347 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:31.273318    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:31.393130 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:31.393101    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:31.544291 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:31.544255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:31.644384 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:31.644241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:32.391927 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:32.391895    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:32.481444 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:32.481412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:35.133391 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:35.133359    2569 generic.go:356] "Generic (PLEG): container finished" podID="c3426925-346d-46d5-9fd6-a46577224567" containerID="1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7" exitCode=0
Jul 14 20:21:35.133900 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:35.133436    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" event={"ID":"c3426925-346d-46d5-9fd6-a46577224567","Type":"ContainerDied","Data":"1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7"}
Jul 14 20:21:35.133967 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:35.133939    2569 scope.go:117] "RemoveContainer" containerID="1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7"
Jul 14 20:21:35.137488 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:35.137456    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:35.137582 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:35.137545    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:35.137641 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:35.137597    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:35.686218 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:35.686173    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:36.147669 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:36.147626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" event={"ID":"c3426925-346d-46d5-9fd6-a46577224567","Type":"ContainerStarted","Data":"ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b"}
Jul 14 20:21:37.022279 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:37.022250    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:37.023244 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:37.023219    2569 patch_prober.go:28] interesting pod/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 14 20:21:37.023373 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:37.023306    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 14 20:21:37.065446 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:37.065409    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:38.022086 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:38.022043    2569 patch_prober.go:28] interesting pod/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 14 20:21:38.022586 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:38.022099    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 14 20:21:39.022959 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:39.022923    2569 patch_prober.go:28] interesting pod/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 14 20:21:39.023343 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:39.023003    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 14 20:21:40.022577 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:40.022546    2569 patch_prober.go:28] interesting pod/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 14 20:21:40.022801 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:40.022769    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 14 20:21:41.026067 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:41.026026    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:41.027169 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:41.027153    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:21:43.188567 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:43.188536    2569 generic.go:356] "Generic (PLEG): container finished" podID="d3be575b-62db-4f43-81d8-9ffb03158195" containerID="6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3" exitCode=0
Jul 14 20:21:43.189119 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:43.188610    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" event={"ID":"d3be575b-62db-4f43-81d8-9ffb03158195","Type":"ContainerDied","Data":"6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3"}
Jul 14 20:21:43.189119 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:43.189002    2569 scope.go:117] "RemoveContainer" containerID="6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3"
Jul 14 20:21:43.190559 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:43.190503    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:43.190730 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:43.190683    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:43.190921 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:43.190880    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 14 20:21:44.194408 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:44.194375    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" event={"ID":"d3be575b-62db-4f43-81d8-9ffb03158195","Type":"ContainerStarted","Data":"96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba"}
Jul 14 20:21:44.720271 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:44.720235    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:44.721435 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:44.721408    2569 patch_prober.go:28] interesting pod/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 14 20:21:44.721549 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:44.721460    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" podUID="d3be575b-62db-4f43-81d8-9ffb03158195" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 14 20:21:45.109839 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:45.109755    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:45.719882 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:45.719848    2569 patch_prober.go:28] interesting pod/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 14 20:21:45.720263 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:45.719914    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" podUID="d3be575b-62db-4f43-81d8-9ffb03158195" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 14 20:21:46.026282 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:46.026198    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:46.720335 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:46.720297    2569 patch_prober.go:28] interesting pod/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 14 20:21:46.720752 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:46.720352    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" podUID="d3be575b-62db-4f43-81d8-9ffb03158195" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 14 20:21:47.675448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:47.675409    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:47.719831 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:47.719793    2569 patch_prober.go:28] interesting pod/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 14 20:21:47.720024 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:47.719846    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" podUID="d3be575b-62db-4f43-81d8-9ffb03158195" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 14 20:21:48.724266 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:48.724234    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:48.725163 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:48.725145    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:21:53.618866 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:53.618830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:53.798092 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:53.798063    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:21:55.115583 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:21:55.115554    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:22.357046 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:22:22.357010    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:43.198463 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:22:43.198425    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:22:55.563167 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:22:55.563090    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:22:55.571552 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:22:55.571523    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:23:17.766325 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:23:17.766273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:17.177952 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:24:17.177867    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:17.277099 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:24:17.277067    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:26.229409 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:24:26.229373    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:27.230874 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:24:27.230840    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:29.947408 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:24:29.947379    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:30.048586 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:24:30.048548    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:24:45.354743 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:24:45.354688    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:16.973835 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:25:16.973793    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:25:26.199202 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:25:26.199168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:02.456634 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:26:02.456600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:03.428864 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:26:03.428832    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:15.544966 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:26:15.544919    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:38.780524 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:26:38.780488    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:47.286088 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:26:47.286050    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:47.377138 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:26:47.377103    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:54.795405 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:26:54.795367    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:26:58.296344 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:26:58.296307    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:27:30.290965 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:27:30.290876    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:27:31.267076 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:27:31.267047    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:27:51.334884 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:27:51.334850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:27:51.435440 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:27:51.435413    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:27:55.591775 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:27:55.591743    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:27:55.597601 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:27:55.597580    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q969l_e3c660eb-9fd4-40da-a80e-18c3269f17d3/ovn-acl-logging/0.log"
Jul 14 20:28:01.018344 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.018314    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"]
Jul 14 20:28:01.018868 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.018537    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn" podUID="becc3ac5-126e-468b-9371-edc39a5ab9d7" containerName="maas-api" containerID="cri-o://7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76" gracePeriod=30
Jul 14 20:28:01.050731 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.050681    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:01.087858 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.087825    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn" podUID="becc3ac5-126e-468b-9371-edc39a5ab9d7" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.44:8443/health\": dial tcp 10.132.0.44:8443: connect: connection refused"
Jul 14 20:28:01.270769 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.270718    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:28:01.305422 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.305395    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becc3ac5-126e-468b-9371-edc39a5ab9d7-maas-api-tls\") pod \"becc3ac5-126e-468b-9371-edc39a5ab9d7\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") "
Jul 14 20:28:01.305545 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.305436    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg8jd\" (UniqueName: \"kubernetes.io/projected/becc3ac5-126e-468b-9371-edc39a5ab9d7-kube-api-access-tg8jd\") pod \"becc3ac5-126e-468b-9371-edc39a5ab9d7\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") "
Jul 14 20:28:01.305545 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.305522    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becc3ac5-126e-468b-9371-edc39a5ab9d7-openshift-service-ca\") pod \"becc3ac5-126e-468b-9371-edc39a5ab9d7\" (UID: \"becc3ac5-126e-468b-9371-edc39a5ab9d7\") "
Jul 14 20:28:01.305850 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.305819    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/becc3ac5-126e-468b-9371-edc39a5ab9d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "becc3ac5-126e-468b-9371-edc39a5ab9d7" (UID: "becc3ac5-126e-468b-9371-edc39a5ab9d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:28:01.307450 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.307421    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/becc3ac5-126e-468b-9371-edc39a5ab9d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "becc3ac5-126e-468b-9371-edc39a5ab9d7" (UID: "becc3ac5-126e-468b-9371-edc39a5ab9d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 20:28:01.307586 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.307558    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/becc3ac5-126e-468b-9371-edc39a5ab9d7-kube-api-access-tg8jd" (OuterVolumeSpecName: "kube-api-access-tg8jd") pod "becc3ac5-126e-468b-9371-edc39a5ab9d7" (UID: "becc3ac5-126e-468b-9371-edc39a5ab9d7"). InnerVolumeSpecName "kube-api-access-tg8jd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:28:01.406853 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.406825    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg8jd\" (UniqueName: \"kubernetes.io/projected/becc3ac5-126e-468b-9371-edc39a5ab9d7-kube-api-access-tg8jd\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:01.406853 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.406848    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/becc3ac5-126e-468b-9371-edc39a5ab9d7-openshift-service-ca\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:01.406853 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.406858    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/becc3ac5-126e-468b-9371-edc39a5ab9d7-maas-api-tls\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:01.825126 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.825095    2569 generic.go:356] "Generic (PLEG): container finished" podID="becc3ac5-126e-468b-9371-edc39a5ab9d7" containerID="7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76" exitCode=0
Jul 14 20:28:01.825285 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.825136    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"
Jul 14 20:28:01.825285 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.825173    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn" event={"ID":"becc3ac5-126e-468b-9371-edc39a5ab9d7","Type":"ContainerDied","Data":"7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76"}
Jul 14 20:28:01.825285 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.825225    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn" event={"ID":"becc3ac5-126e-468b-9371-edc39a5ab9d7","Type":"ContainerDied","Data":"3ff29567859d2a3f49fd0bd1be6a713d443d1d7f7526a87ff058485ef3d100cf"}
Jul 14 20:28:01.825285 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.825247    2569 scope.go:117] "RemoveContainer" containerID="7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76"
Jul 14 20:28:01.833201 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.833182    2569 scope.go:117] "RemoveContainer" containerID="7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76"
Jul 14 20:28:01.833441 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:28:01.833424    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76\": container with ID starting with 7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76 not found: ID does not exist" containerID="7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76"
Jul 14 20:28:01.833490 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.833452    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76"} err="failed to get container status \"7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76\": rpc error: code = NotFound desc = could not find container \"7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76\": container with ID starting with 7ad3933227fc2f9be0e6dab753a8b96ae6b313119620c92e39d1e4ff9716fb76 not found: ID does not exist"
Jul 14 20:28:01.841990 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.841966    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"]
Jul 14 20:28:01.845856 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:01.845836    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-76db83-5698dc6c98-zzxwn"]
Jul 14 20:28:03.444397 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:03.444364    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="becc3ac5-126e-468b-9371-edc39a5ab9d7" path="/var/lib/kubelet/pods/becc3ac5-126e-468b-9371-edc39a5ab9d7/volumes"
Jul 14 20:28:05.627770 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:05.627736    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:06.551377 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:06.551344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:11.983227 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:11.983190    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:12.044498 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:12.044473    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:16.343381 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:16.343346    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"]
Jul 14 20:28:16.343773 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:16.343568    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy" containerID="cri-o://ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b" gracePeriod=30
Jul 14 20:28:16.385938 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:16.385909    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:16.613180 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:16.613071    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:17.521882 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:17.521850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:17.620589 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:17.620555    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:21.597373 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.597348    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:28:21.671851 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.671827    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-istio-token\") pod \"c3426925-346d-46d5-9fd6-a46577224567\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") "
Jul 14 20:28:21.671990 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.671866    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-envoy\") pod \"c3426925-346d-46d5-9fd6-a46577224567\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") "
Jul 14 20:28:21.671990 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.671917    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7grt\" (UniqueName: \"kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-kube-api-access-l7grt\") pod \"c3426925-346d-46d5-9fd6-a46577224567\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") "
Jul 14 20:28:21.671990 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.671933    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-credential-socket\") pod \"c3426925-346d-46d5-9fd6-a46577224567\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") "
Jul 14 20:28:21.671990 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.671951    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-data\") pod \"c3426925-346d-46d5-9fd6-a46577224567\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") "
Jul 14 20:28:21.671990 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.671964    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-socket\") pod \"c3426925-346d-46d5-9fd6-a46577224567\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") "
Jul 14 20:28:21.671990 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.671983    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3426925-346d-46d5-9fd6-a46577224567-istiod-ca-cert\") pod \"c3426925-346d-46d5-9fd6-a46577224567\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") "
Jul 14 20:28:21.672288 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.672021    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3426925-346d-46d5-9fd6-a46577224567-istio-podinfo\") pod \"c3426925-346d-46d5-9fd6-a46577224567\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") "
Jul 14 20:28:21.672288 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.672066    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-certs\") pod \"c3426925-346d-46d5-9fd6-a46577224567\" (UID: \"c3426925-346d-46d5-9fd6-a46577224567\") "
Jul 14 20:28:21.672288 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.672241    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3426925-346d-46d5-9fd6-a46577224567" (UID: "c3426925-346d-46d5-9fd6-a46577224567"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:21.672288 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.672267    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3426925-346d-46d5-9fd6-a46577224567" (UID: "c3426925-346d-46d5-9fd6-a46577224567"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:21.672494 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.672363    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:21.672494 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.672470    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3426925-346d-46d5-9fd6-a46577224567-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3426925-346d-46d5-9fd6-a46577224567" (UID: "c3426925-346d-46d5-9fd6-a46577224567"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:28:21.672661 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.672639    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3426925-346d-46d5-9fd6-a46577224567" (UID: "c3426925-346d-46d5-9fd6-a46577224567"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:21.672879 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.672848    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3426925-346d-46d5-9fd6-a46577224567" (UID: "c3426925-346d-46d5-9fd6-a46577224567"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:21.674077 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.674049    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-kube-api-access-l7grt" (OuterVolumeSpecName: "kube-api-access-l7grt") pod "c3426925-346d-46d5-9fd6-a46577224567" (UID: "c3426925-346d-46d5-9fd6-a46577224567"). InnerVolumeSpecName "kube-api-access-l7grt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:28:21.674282 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.674256    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3426925-346d-46d5-9fd6-a46577224567-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3426925-346d-46d5-9fd6-a46577224567" (UID: "c3426925-346d-46d5-9fd6-a46577224567"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:28:21.674367 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.674285    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3426925-346d-46d5-9fd6-a46577224567" (UID: "c3426925-346d-46d5-9fd6-a46577224567"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:21.674367 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.674338    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3426925-346d-46d5-9fd6-a46577224567" (UID: "c3426925-346d-46d5-9fd6-a46577224567"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:28:21.773142 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.773117    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:21.773142 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.773139    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:21.773293 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.773148    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7grt\" (UniqueName: \"kubernetes.io/projected/c3426925-346d-46d5-9fd6-a46577224567-kube-api-access-l7grt\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:21.773293 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.773159    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:21.773293 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.773167    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:21.773293 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.773174    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3426925-346d-46d5-9fd6-a46577224567-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:21.773293 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.773182    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3426925-346d-46d5-9fd6-a46577224567-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:21.773293 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.773190    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3426925-346d-46d5-9fd6-a46577224567-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:21.922576 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.922494    2569 generic.go:356] "Generic (PLEG): container finished" podID="c3426925-346d-46d5-9fd6-a46577224567" containerID="ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b" exitCode=0
Jul 14 20:28:21.922576 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.922538    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"
Jul 14 20:28:21.922761 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.922578    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" event={"ID":"c3426925-346d-46d5-9fd6-a46577224567","Type":"ContainerDied","Data":"ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b"}
Jul 14 20:28:21.922761 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.922634    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk" event={"ID":"c3426925-346d-46d5-9fd6-a46577224567","Type":"ContainerDied","Data":"bda273657c97d1d0c512260a761a1b8126e80fbb947904136591e903c76fa0c1"}
Jul 14 20:28:21.922761 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.922660    2569 scope.go:117] "RemoveContainer" containerID="ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b"
Jul 14 20:28:21.931486 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.931470    2569 scope.go:117] "RemoveContainer" containerID="1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7"
Jul 14 20:28:21.938648 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.938632    2569 scope.go:117] "RemoveContainer" containerID="ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b"
Jul 14 20:28:21.938910 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:28:21.938892    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b\": container with ID starting with ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b not found: ID does not exist" containerID="ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b"
Jul 14 20:28:21.938961 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.938919    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b"} err="failed to get container status \"ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b\": rpc error: code = NotFound desc = could not find container \"ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b\": container with ID starting with ea117fc3842cced9ad1f585bce8c24ace5974a6008f13d03b8ae1f7738c6487b not found: ID does not exist"
Jul 14 20:28:21.938961 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.938935    2569 scope.go:117] "RemoveContainer" containerID="1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7"
Jul 14 20:28:21.939175 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:28:21.939158    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7\": container with ID starting with 1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7 not found: ID does not exist" containerID="1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7"
Jul 14 20:28:21.939219 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.939183    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7"} err="failed to get container status \"1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7\": rpc error: code = NotFound desc = could not find container \"1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7\": container with ID starting with 1255182c5e19e3005a8ab5f54d25dcf009cab9b5c1a463d94be650e8d4bd03f7 not found: ID does not exist"
Jul 14 20:28:21.944341 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.944320    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"]
Jul 14 20:28:21.950431 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:21.950411    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-76db83-openshift-default-6f55ccd947-zfkdk"]
Jul 14 20:28:23.444972 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:23.444931    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3426925-346d-46d5-9fd6-a46577224567" path="/var/lib/kubelet/pods/c3426925-346d-46d5-9fd6-a46577224567/volumes"
Jul 14 20:28:27.194808 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:27.194767    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:31.817600 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:31.817569    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:38.232450 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:38.232414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:38.339004 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:38.338967    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:42.569617 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:42.569583    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"]
Jul 14 20:28:42.570079 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:42.569859    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" podUID="d3be575b-62db-4f43-81d8-9ffb03158195" containerName="istio-proxy" containerID="cri-o://96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba" gracePeriod=30
Jul 14 20:28:42.585975 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:42.585944    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:42.842845 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:42.842767    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:28:47.809848 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.809824    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:28:47.983868 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.983841    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-envoy\") pod \"d3be575b-62db-4f43-81d8-9ffb03158195\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") "
Jul 14 20:28:47.984016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.983878    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-data\") pod \"d3be575b-62db-4f43-81d8-9ffb03158195\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") "
Jul 14 20:28:47.984016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.983923    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3be575b-62db-4f43-81d8-9ffb03158195-istio-podinfo\") pod \"d3be575b-62db-4f43-81d8-9ffb03158195\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") "
Jul 14 20:28:47.984016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.983946    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3be575b-62db-4f43-81d8-9ffb03158195-istiod-ca-cert\") pod \"d3be575b-62db-4f43-81d8-9ffb03158195\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") "
Jul 14 20:28:47.984016 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.983970    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-certs\") pod \"d3be575b-62db-4f43-81d8-9ffb03158195\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") "
Jul 14 20:28:47.984251 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.984016    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-credential-socket\") pod \"d3be575b-62db-4f43-81d8-9ffb03158195\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") "
Jul 14 20:28:47.984251 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.984059    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-istio-token\") pod \"d3be575b-62db-4f43-81d8-9ffb03158195\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") "
Jul 14 20:28:47.984251 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.984083    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv696\" (UniqueName: \"kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-kube-api-access-pv696\") pod \"d3be575b-62db-4f43-81d8-9ffb03158195\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") "
Jul 14 20:28:47.984251 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.984117    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-socket\") pod \"d3be575b-62db-4f43-81d8-9ffb03158195\" (UID: \"d3be575b-62db-4f43-81d8-9ffb03158195\") "
Jul 14 20:28:47.984464 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.984288    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3be575b-62db-4f43-81d8-9ffb03158195" (UID: "d3be575b-62db-4f43-81d8-9ffb03158195"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:47.984541 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.984520    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3be575b-62db-4f43-81d8-9ffb03158195" (UID: "d3be575b-62db-4f43-81d8-9ffb03158195"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:47.984791 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.984754    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3be575b-62db-4f43-81d8-9ffb03158195-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3be575b-62db-4f43-81d8-9ffb03158195" (UID: "d3be575b-62db-4f43-81d8-9ffb03158195"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 20:28:47.984791 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.984774    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3be575b-62db-4f43-81d8-9ffb03158195" (UID: "d3be575b-62db-4f43-81d8-9ffb03158195"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:47.984977 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.984950    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3be575b-62db-4f43-81d8-9ffb03158195" (UID: "d3be575b-62db-4f43-81d8-9ffb03158195"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:47.986198 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.986165    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3be575b-62db-4f43-81d8-9ffb03158195" (UID: "d3be575b-62db-4f43-81d8-9ffb03158195"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 20:28:47.986307 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.986226    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3be575b-62db-4f43-81d8-9ffb03158195" (UID: "d3be575b-62db-4f43-81d8-9ffb03158195"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:28:47.986307 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.986251    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-kube-api-access-pv696" (OuterVolumeSpecName: "kube-api-access-pv696") pod "d3be575b-62db-4f43-81d8-9ffb03158195" (UID: "d3be575b-62db-4f43-81d8-9ffb03158195"). InnerVolumeSpecName "kube-api-access-pv696". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 20:28:47.986542 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:47.986524    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3be575b-62db-4f43-81d8-9ffb03158195-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3be575b-62db-4f43-81d8-9ffb03158195" (UID: "d3be575b-62db-4f43-81d8-9ffb03158195"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 14 20:28:48.032978 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.032952    2569 generic.go:356] "Generic (PLEG): container finished" podID="d3be575b-62db-4f43-81d8-9ffb03158195" containerID="96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba" exitCode=0
Jul 14 20:28:48.033079 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.033009    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"
Jul 14 20:28:48.033079 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.033031    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" event={"ID":"d3be575b-62db-4f43-81d8-9ffb03158195","Type":"ContainerDied","Data":"96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba"}
Jul 14 20:28:48.033150 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.033089    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p" event={"ID":"d3be575b-62db-4f43-81d8-9ffb03158195","Type":"ContainerDied","Data":"fcb4e56af6f4446e3f349b35b0f3877bb115f2d0d979d31570768fc441b76751"}
Jul 14 20:28:48.033150 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.033114    2569 scope.go:117] "RemoveContainer" containerID="96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba"
Jul 14 20:28:48.041830 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.041802    2569 scope.go:117] "RemoveContainer" containerID="6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3"
Jul 14 20:28:48.048748 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.048732    2569 scope.go:117] "RemoveContainer" containerID="96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba"
Jul 14 20:28:48.048985 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:28:48.048970    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba\": container with ID starting with 96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba not found: ID does not exist" containerID="96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba"
Jul 14 20:28:48.049025 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.048991    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba"} err="failed to get container status \"96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba\": rpc error: code = NotFound desc = could not find container \"96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba\": container with ID starting with 96a029a0f0ed555099570cc5c412dac1dd9bd66644f5139c40acdf85f4ab87ba not found: ID does not exist"
Jul 14 20:28:48.049025 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.049005    2569 scope.go:117] "RemoveContainer" containerID="6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3"
Jul 14 20:28:48.049194 ip-10-0-136-12 kubenswrapper[2569]: E0714 20:28:48.049179    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3\": container with ID starting with 6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3 not found: ID does not exist" containerID="6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3"
Jul 14 20:28:48.049230 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.049198    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3"} err="failed to get container status \"6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3\": rpc error: code = NotFound desc = could not find container \"6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3\": container with ID starting with 6578aae76db362c76faa69ae5c7c18f90f7f9e27c3c444c33e9b9fbd229388a3 not found: ID does not exist"
Jul 14 20:28:48.054746 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.054725    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"]
Jul 14 20:28:48.058653 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.058634    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ecc78d-openshift-default-58d878f9c5-jj87p"]
Jul 14 20:28:48.085428 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.085408    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-istio-token\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:48.085428 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.085430    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv696\" (UniqueName: \"kubernetes.io/projected/d3be575b-62db-4f43-81d8-9ffb03158195-kube-api-access-pv696\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:48.085556 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.085440    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:48.085556 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.085450    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-envoy\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:48.085556 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.085458    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-istio-data\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:48.085556 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.085465    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3be575b-62db-4f43-81d8-9ffb03158195-istio-podinfo\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:48.085556 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.085472    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3be575b-62db-4f43-81d8-9ffb03158195-istiod-ca-cert\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:48.085556 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.085480    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-workload-certs\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:48.085556 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.085488    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3be575b-62db-4f43-81d8-9ffb03158195-credential-socket\") on node \"ip-10-0-136-12.ec2.internal\" DevicePath \"\""
Jul 14 20:28:48.952147 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:48.952102    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5966dd7959-k56ng_71162aad-28af-4e45-bc07-66fd822f049d/manager/0.log"
Jul 14 20:28:49.444769 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:49.444737    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3be575b-62db-4f43-81d8-9ffb03158195" path="/var/lib/kubelet/pods/d3be575b-62db-4f43-81d8-9ffb03158195/volumes"
Jul 14 20:28:49.616481 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:49.616458    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdfc6fcb8-plk5s_05f373da-aa99-4a1b-ab07-069aa712f496/copy-manifests/0.log"
Jul 14 20:28:49.629440 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:49.629419    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdfc6fcb8-plk5s_05f373da-aa99-4a1b-ab07-069aa712f496/manager/0.log"
Jul 14 20:28:50.035276 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:50.035241    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8559b688dd-gmn9q_43e332a1-ce10-40f5-9af1-d4204210d1c3/maas-api/0.log"
Jul 14 20:28:51.874786 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:51.874755    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dm92x_991a2196-b426-4e2e-96d5-741015e631c5/postgres/0.log"
Jul 14 20:28:54.747292 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:54.747260    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rj44h_c4d12f92-5a19-45e3-9ef6-c6fe48920596/discovery/0.log"
Jul 14 20:28:55.408040 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:55.408017    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-6bxvm_8388398d-30b1-47d1-865c-814b4dc41753/payload-processing/0.log"
Jul 14 20:28:55.907191 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:28:55.907160    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2kvlk_2e092756-5c55-4eff-8631-24f34039ed09/main/0.log"
Jul 14 20:29:01.176687 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:01.176657    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:01.269739 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:01.269712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:04.454931 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:04.454900    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lxm7p_a3aad93b-06f9-4f52-bd2e-3602a4e4d79e/global-pull-secret-syncer/0.log"
Jul 14 20:29:04.612383 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:04.612354    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log"
Jul 14 20:29:04.753998 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:04.753922    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-12.ec2.internal_e9ca441aec6f18be4b0922c5dc5643a9/haproxy/0.log"
Jul 14 20:29:12.422183 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.422155    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-bnm5q_4b848658-c3df-44bb-a8d4-76fc9d4a3b26/monitoring-plugin/0.log"
Jul 14 20:29:12.722578 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.722551    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2vcr_7aa25975-2af8-464c-8008-ecd0292204a8/node-exporter/0.log"
Jul 14 20:29:12.744759 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.744739    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2vcr_7aa25975-2af8-464c-8008-ecd0292204a8/kube-rbac-proxy/0.log"
Jul 14 20:29:12.771602 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.771581    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2vcr_7aa25975-2af8-464c-8008-ecd0292204a8/init-textfile/0.log"
Jul 14 20:29:12.799925 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.799900    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-shzps_993bed2e-f043-4ce4-963c-4bcac35e98ad/kube-rbac-proxy-main/0.log"
Jul 14 20:29:12.821784 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.821766    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-shzps_993bed2e-f043-4ce4-963c-4bcac35e98ad/kube-rbac-proxy-self/0.log"
Jul 14 20:29:12.844591 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.844572    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-shzps_993bed2e-f043-4ce4-963c-4bcac35e98ad/openshift-state-metrics/0.log"
Jul 14 20:29:12.884670 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.884653    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/prometheus/0.log"
Jul 14 20:29:12.907125 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.907110    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/config-reloader/0.log"
Jul 14 20:29:12.929423 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.929398    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/thanos-sidecar/0.log"
Jul 14 20:29:12.950934 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.950918    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/kube-rbac-proxy-web/0.log"
Jul 14 20:29:12.974272 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.974223    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/kube-rbac-proxy/0.log"
Jul 14 20:29:12.996708 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:12.996674    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/kube-rbac-proxy-thanos/0.log"
Jul 14 20:29:13.020057 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:13.020039    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bd679875-aa45-4698-9051-6d083fcaf0ed/init-config-reloader/0.log"
Jul 14 20:29:14.896998 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.896961    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"]
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897285    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897295    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897308    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3be575b-62db-4f43-81d8-9ffb03158195" containerName="istio-proxy"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897314    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3be575b-62db-4f43-81d8-9ffb03158195" containerName="istio-proxy"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897326    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897331    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897347    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="becc3ac5-126e-468b-9371-edc39a5ab9d7" containerName="maas-api"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897353    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="becc3ac5-126e-468b-9371-edc39a5ab9d7" containerName="maas-api"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897398    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897409    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3be575b-62db-4f43-81d8-9ffb03158195" containerName="istio-proxy"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897415    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="becc3ac5-126e-468b-9371-edc39a5ab9d7" containerName="maas-api"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897421    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3be575b-62db-4f43-81d8-9ffb03158195" containerName="istio-proxy"
Jul 14 20:29:14.897448 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.897427    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3426925-346d-46d5-9fd6-a46577224567" containerName="istio-proxy"
Jul 14 20:29:14.900390 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.900367    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:14.903112 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.903090    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7kv5j\"/\"openshift-service-ca.crt\""
Jul 14 20:29:14.903224 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.903147    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7kv5j\"/\"kube-root-ca.crt\""
Jul 14 20:29:14.903601 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.903578    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7kv5j\"/\"default-dockercfg-7vshp\""
Jul 14 20:29:14.907826 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.907806    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"]
Jul 14 20:29:14.996036 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.996009    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hxnc\" (UniqueName: \"kubernetes.io/projected/9e3131fb-bdb7-4b11-acfb-431ed4156905-kube-api-access-9hxnc\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:14.996200 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.996045    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-proc\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:14.996200 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.996062    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-lib-modules\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:14.996200 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.996089    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-podres\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:14.996200 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:14.996161    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-sys\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.096758 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.096717    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hxnc\" (UniqueName: \"kubernetes.io/projected/9e3131fb-bdb7-4b11-acfb-431ed4156905-kube-api-access-9hxnc\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.096931 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.096767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-proc\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.096931 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.096784    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-lib-modules\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.096931 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.096819    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-podres\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.096931 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.096849    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-sys\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.096931 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.096857    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-proc\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.096931 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.096923    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-sys\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.097217 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.097001    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-podres\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.097217 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.097001    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e3131fb-bdb7-4b11-acfb-431ed4156905-lib-modules\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.104910 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.104882    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hxnc\" (UniqueName: \"kubernetes.io/projected/9e3131fb-bdb7-4b11-acfb-431ed4156905-kube-api-access-9hxnc\") pod \"perf-node-gather-daemonset-tsqcq\" (UID: \"9e3131fb-bdb7-4b11-acfb-431ed4156905\") " pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.211264 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.211187    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:15.336586 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:15.336563    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"]
Jul 14 20:29:15.338750 ip-10-0-136-12 kubenswrapper[2569]: W0714 20:29:15.338726    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e3131fb_bdb7_4b11_acfb_431ed4156905.slice/crio-832e4c3577510fd49ffd9b00c1fe79ce02661f52db70517f3a954ea575da5fa7 WatchSource:0}: Error finding container 832e4c3577510fd49ffd9b00c1fe79ce02661f52db70517f3a954ea575da5fa7: Status 404 returned error can't find the container with id 832e4c3577510fd49ffd9b00c1fe79ce02661f52db70517f3a954ea575da5fa7
Jul 14 20:29:16.155255 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:16.155220    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq" event={"ID":"9e3131fb-bdb7-4b11-acfb-431ed4156905","Type":"ContainerStarted","Data":"0164d606a22ea065648dab1bebd7a60d6c466731498aedb62c975058e9494e36"}
Jul 14 20:29:16.155729 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:16.155279    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq" event={"ID":"9e3131fb-bdb7-4b11-acfb-431ed4156905","Type":"ContainerStarted","Data":"832e4c3577510fd49ffd9b00c1fe79ce02661f52db70517f3a954ea575da5fa7"}
Jul 14 20:29:16.155729 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:16.155338    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:16.172152 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:16.172111    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq" podStartSLOduration=2.172097775 podStartE2EDuration="2.172097775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:29:16.170188361 +0000 UTC m=+3081.227707900" watchObservedRunningTime="2026-07-14 20:29:16.172097775 +0000 UTC m=+3081.229617315"
Jul 14 20:29:17.719856 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:17.719830    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smbdz_4f3189cc-6793-417a-9aa9-9674b1b6f793/dns/0.log"
Jul 14 20:29:17.741352 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:17.741332    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-smbdz_4f3189cc-6793-417a-9aa9-9674b1b6f793/kube-rbac-proxy/0.log"
Jul 14 20:29:17.789683 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:17.789660    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wchmn_c2f1d400-6300-4f87-9afd-39f401c4fba9/dns-node-resolver/0.log"
Jul 14 20:29:18.089086 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:18.089011    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:18.188363 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:18.188320    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j8v8q_d1a86d2d-d43b-49ed-9358-6483ff2f8394/konnectivity-agent/0.log" limit=1024
Jul 14 20:29:18.459688 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:18.459658    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-stxdp_71c434f7-a30f-42b1-b347-bc7d5e630991/node-ca/0.log"
Jul 14 20:29:19.583047 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:19.583019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rj44h_c4d12f92-5a19-45e3-9ef6-c6fe48920596/discovery/0.log"
Jul 14 20:29:19.784386 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:19.784352    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-6bxvm_8388398d-30b1-47d1-865c-814b4dc41753/payload-processing/0.log"
Jul 14 20:29:20.611518 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:20.611490    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ww5zf_bdf0ad82-65fb-40ac-9729-fcade69a2cde/serve-healthcheck-canary/0.log"
Jul 14 20:29:21.304915 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:21.304880    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7xqb_fcd3593b-6bd6-42c3-bb47-ddefa4f472ad/kube-rbac-proxy/0.log"
Jul 14 20:29:21.330243 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:21.330220    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7xqb_fcd3593b-6bd6-42c3-bb47-ddefa4f472ad/exporter/0.log"
Jul 14 20:29:21.355888 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:21.355869    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w7xqb_fcd3593b-6bd6-42c3-bb47-ddefa4f472ad/extractor/0.log"
Jul 14 20:29:22.169333 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:22.169303    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7kv5j/perf-node-gather-daemonset-tsqcq"
Jul 14 20:29:24.102588 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:24.102555    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5966dd7959-k56ng_71162aad-28af-4e45-bc07-66fd822f049d/manager/0.log"
Jul 14 20:29:24.430843 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:24.430814    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdfc6fcb8-plk5s_05f373da-aa99-4a1b-ab07-069aa712f496/manager/0.log"
Jul 14 20:29:24.450708 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:24.450679    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fdfc6fcb8-plk5s_05f373da-aa99-4a1b-ab07-069aa712f496/copy-manifests/0.log"
Jul 14 20:29:25.875542 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:25.875511    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f49b85c7f-8d5wd_ee5de2ba-8421-4f9a-81eb-a4f598fc5164/manager/0.log"
Jul 14 20:29:26.255687 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:26.255608    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rj44h_c4d12f92-5a19-45e3-9ef6-c6fe48920596/discovery/0.log"
Jul 14 20:29:26.392144 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:26.392111    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-6bxvm_8388398d-30b1-47d1-865c-814b4dc41753/payload-processing/0.log"
Jul 14 20:29:27.779616 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:27.779587    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rj44h_c4d12f92-5a19-45e3-9ef6-c6fe48920596/discovery/0.log"
Jul 14 20:29:27.912234 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:27.912205    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-6bxvm_8388398d-30b1-47d1-865c-814b4dc41753/payload-processing/0.log"
Jul 14 20:29:32.880426 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:32.880395    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l5kq_c1a0f0e9-3e41-48d7-ae5a-edde773b9a28/kube-multus-additional-cni-plugins/0.log"
Jul 14 20:29:32.903967 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:32.903942    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l5kq_c1a0f0e9-3e41-48d7-ae5a-edde773b9a28/egress-router-binary-copy/0.log"
Jul 14 20:29:32.931521 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:32.931497    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l5kq_c1a0f0e9-3e41-48d7-ae5a-edde773b9a28/cni-plugins/0.log"
Jul 14 20:29:32.951333 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:32.951313    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l5kq_c1a0f0e9-3e41-48d7-ae5a-edde773b9a28/bond-cni-plugin/0.log"
Jul 14 20:29:32.972266 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:32.972232    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l5kq_c1a0f0e9-3e41-48d7-ae5a-edde773b9a28/routeoverride-cni/0.log"
Jul 14 20:29:32.993915 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:32.993895    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l5kq_c1a0f0e9-3e41-48d7-ae5a-edde773b9a28/whereabouts-cni-bincopy/0.log"
Jul 14 20:29:33.018593 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:33.018575    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8l5kq_c1a0f0e9-3e41-48d7-ae5a-edde773b9a28/whereabouts-cni/0.log"
Jul 14 20:29:33.223002 ip-10-0-136-12 kubenswrapper[2569]: I0714 20:29:33.222917    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k5qgw_a75cc395-0853-4261-8d27-d4a7f1df5af5/kube-multus/0.log"